Schedule dataflow
In the Scheduling step:
- Set the Frequency to Minute.
- Set the Interval to 15 i.e. 15 minutes.
- Turn the Backfill option on.
NOTE
Observe that the Start time is in UTC.
Coordinated Universal Time (UTC) is a global time standard that is used as a reference point for timekeeping worldwide. For a globally distributed team, it provides a common reference for various regions and countries, making it easier to coordinate activities and schedule events across different time zones.
In different parts of the AEP UI, you see UTC time as the basis of the time scheduling. UTC time is 1 hour behind London time. If you are unsure about the UTC time, simply google “UTC time now”.
NOTE
In practice, the Backfill option does a one-time backfill of all the files and subsequent runs take new files.
Review the data flow and click Finish.
CAUTION
If you choose the Run once option for your dataflow, you’re not able to edit this schedule or update the dataflow later. However, you can run the dataflow on demand i.e. run again if you need to ingest new data.
After you click Finish, you’re brought back to the Dataflows screen. It should take a few minutes to create the Dataflow. Notice that Last Dataflow Run Status indicates No runs. The first run should kick in a couple of minutes.
NOTE
You need to refresh the page continuously to see the status update as the backend does not push updates out to the UI.
NOTE
If you turned on all the alerts you receive an alert in your browser in the upper right corner of your browser when the flow starts running and successfully completes or fails
recommendation-more-help
blueprints-learn-help-blueprints