Query schedules

You can automate query runs by creating query schedules. Scheduled queries run on a custom cadence to manage your data based on frequency, date, and time. You can also choose an output dataset for your results if required. Queries that have been saved as a template can be scheduled from the Query Editor.

You can only add a schedule to a query that has already been created, and saved.

Any scheduled queries are added to the list in the Scheduled queries tab. From that workspace you can monitor the status of all scheduled query jobs through the UI. On the Scheduled queries tab you can find important information about your query runs and subscribe to alerts. The available information includes the status, schedule details, and error messages/codes should a run fail. See the Monitor scheduled queries document for more information.

This workflow covers the scheduling process in the Query Service UI. To learn how to add schedules using the API, please read the scheduled queries endpoint guide.

Create a query schedule create-schedule

To schedule a query, select a query template from either the Templates tab or the Template column of the Scheduled Queries tab. Selecting the template name navigates you to the Query Editor.

If you access a saved query from the Query Editor, you can create a schedule for the query or view the query’s schedule from the details panel.

Select View schedule to navigate to the schedules workspace and see any scheduled query runs at a glance.

The Query Editor wih View schedule and Add schedule highlighted.

Select Add schedule to navigate to the schedule details page.

Alternatively, select the Schedules tab below the query’s name.

The Query Editor with the Schedules tab highlighted.

The schedules workspace appears. The UI displays a list of any scheduled runs that the template is associated with. Select Add Schedule to create a schedule.

The Query Editor Schedule workspace with Add schedule highlighted.

Add schedule details schedule-details

The schedule details page appears. On this page, you can edit a variety of details for the scheduled query. Details include the frequency and weekday of the scheduled query run, the start and end date, the dataset to export the results to, and query status alerts.

The Schedule details panel highlighted.

Scheduled query frequency scheduled-query-frequency

You can choose the following options for Frequency:

  • Hourly: The scheduled query will run every hour for the date period you selected.
  • Daily: The scheduled query will run every X days at the time and the date period you selected. Please note that the time selected is in UTC, and not your local time zone.
  • Weekly: The selected query will run on the days of the week, time, and the date period you selected. Please note that the time selected is in UTC, and not your local time zone.
  • Monthly: The selected query will run every month at the day, time, and the date period you selected. Please note that the time selected is in UTC, and not your local time zone.
  • Yearly: The selected query will run every year at the day, month, time, and the date period you selected. Please note that the time selected is in UTC, and not your local time zone.

Provide dataset details dataset-details

Manage the query results by either appending the data to an existing dataset or creating a new dataset and appending the data to it.

Select Create and append into new dataset to create a data set when you execute a query for the first time. Subsequent executions continue to insert data into that data set. Lastly, provide a name and description for the dataset.

Since you are using either an existing or creating a new dataset, you do not need to include either INSERT INTO or CREATE TABLE AS SELECT as part of the query, since the datasets are already set. Including either INSERT INTO or CREATE TABLE AS SELECT as part of your scheduled queries will result in an error.

The Schedule details panel with Dataset details and the Create and append into new dataset options highlighted.

Alternatively, select Append into existing dataset followed by the dataset icon ( The dataset icon. ).

The Schedule details panel with Dataset details and Append into existing dataset highlighted.

The Select output dataset dialog appears.

Next, either browse the existing datasets or use the search field to filter the options. Select the row of the dataset that you wish to use. The dataset details are displayed in the panel on the right. Select Done to confirm your choice.

The Select output dataset dialog with the search field, a dataset row, and Done highlighted.

Quarantine queries if they continuously fail quarantine

When creating a schedule, you can enroll your query in the quarantine feature to safeguard system resources and prevent potential disruptions. The quarantine feature automatically identifies and isolates queries that repeatedly fail by placing them in a Quarantined state. By quarantining queries after ten consecutive failures, you can intervene, review, and rectify issues before allowing further executions. This helps to maintain your operational efficiency and data integrity.

The Queries Schedules workspace with Query Quarantine highlighted and Yes selected.

Once a query is enrolled for the quarantine feature, you can subscribe to alerts for this query status change. If a scheduled query is not enrolled in quarantine, it does not appear as an option on the Alerts dialog.

You can also enroll a scheduled query into the quarantine feature from the inline actions of the Scheduled Queries tab. See the monitor queries documentation for more details.

Set alerts for a scheduled query status alerts-for-query-status

You can also subscribe to query alerts as part of your scheduled query settings. You can configure your settings to receive notifications for a variety of situations. Alerts can be set for a quarantined state, delays in query processing, or a change in status of your query. The available query-state alert options include start, success, and failure. Alerts can be received either as pop-up notifications or emails. Select the check box to subscribe to alerts for that status of scheduled query.

The Schedule details panel with the Alert options highlighted.

The table below explains the supported query alert types:

Alert type
This alert notifies you when a scheduled query run is initiated or starts to process.
This alert informs you when a scheduled query run completes successfully, indicating that the query executed without any errors.
This alert triggers when a scheduled query run encounters an error or fails to execute successfully. It helps you identify and address issues promptly.
This alert is activated when a scheduled query run is put into a quarantined state. Once a query is enrolled in the quarantine feature, any scheduled query that fails ten consecutive runs is automatically put into a Quarantined state. A quarantined query then requires your intervention before any further executions can take place. Note: Queries must be enrolled for the quarantine feature for you to subscribe to quarantine alerts.
This alert notifies you if there is a delay in the outcome of a scheduled query execution beyond a specified threshold. You can set a custom time that triggers the alert when the query runs for that duration without either completing or failing. The default behavior sets an alert for 150 mins after the query begins processing.
If you choose to set a Query Run Delay alert, you must set your desired delay time in minutes in the Platform UI. Enter the duration in minutes. The maximum delay is 24 hours (1440 minutes).

For an overview of alerts in Adobe Experience Platform, including the structure of how alert rules are defined, see the alerts overview. For guidance on managing alerts and alert rules within the Adobe Experience Platform UI, see the Alerts UI guide.

Set parameters for a scheduled parameterized query set-parameters

The parameterized query UI feature is currently available in a limited release only and is not available to all customers. If you do not have access to parameterized queries, continue on to the delete or disable a schedule section.

If you are creating a scheduled query for a parameterized query, you must now set the parameter values for these query runs.

The Schedule details section of the schedule creation workflow with the Query parameters section highlighted.

After confirming your schedule details, select Save to create a schedule. You are returned to your template’s schedules tab. This workspace displays details of the newly created schedule, including the schedule ID, the schedule itself, and the schedule’s output dataset.

View scheduled query runs scheduled-query-runs

From your template’s Schedules tab, select the schedule ID to navigate to the list of query runs for your newly scheduled query.

The schedules workspace with the newly created schedule highlighted.

Alternatively, to view a list of a query template’s scheduled runs, navigate to the Scheduled queries tab and select a template name from the list available.

The Scheduled queries tab with a named template highlighted.

The list of query runs for that scheduled query appears.

The details section of the Scheduled Queries workspace with a list of query runs highlighted for a scheduled query.

See the monitor scheduled queried guide for complete information on how to monitor the status of all query jobs through the UI.

Select a Query run ID from the list to navigate to the query run overview. For a full breakdown of the information available on the query run overview, see the monitor scheduled queries documentation.

To monitor scheduled queries using the Query Service API, see the scheduled query run endpoints guide.

Enable, disable, or delete a schedule delete-schedule

You can enable, disable, or delete a schedule from the schedules workspace of a particular query or from the Scheduled Queries workspace that lists all the scheduled queries.

To access the Schedules tab of your chosen query, you must select the name of a query template from either the Templates tab or the Scheduled Queries tab. This navigates to the Query Editor for that query. Form the Query Editor, select Schedules to access the schedules workspace.

Select a schedule from the rows of available schedules to populate the details panel. Use the toggle to disable (or enable) the scheduled query.

Delete disabled queries

You must disable the schedule before you can delete a schedule for a query.

The list of a template's schedules with the details panel highlighted.

A confirmation dialog appears. Select Disable to confirm the action.

The Disable schedule confirmation dialog.

Select Delete a schedule to delete the disabled schedule.

The schedules workspace with Delete schedule highlighted.

Alternatively, the Scheduled Queries tab offers a collection of inline actions for each scheduled query. The available inline actions include Disable schedule or Enable schedule, Delete schedule, and Subscribe to alerts for the scheduled query. For complete instructions on how to delete or disable a scheduled query through the scheduled Queries tab, please see the monitor scheduled queried guide.