Monitor scheduled queries

Adobe Experience Platform provides improved visibility for the status of all query jobs through the UI. From the Scheduled Queries tab, you can now find important information about your query runs that includes the status, schedule details, and error messages/codes should they fail. You can also subscribe to alerts for queries based on their status through the UI for any of these queries through Scheduled Queries tab.

Scheduled Queries

The Scheduled Queries tab provides an overview of all your scheduled CTAS and ITAS queries. Run details can be found for all scheduled queries as well as error codes and messages for any failed queries.

To navigate to the Scheduled Queries tab, select Queries from the left navigation bar followed by Scheduled Queries

The table below describes each available column.

NOTE

The alert subscriptions icon ( ) is contained in each row in an untitled column. See the alert subscriptions section for more information.

Customize table settings for scheduled queries customize-table

You can adjust the columns on the Scheduled Queries tab to your needs. To open the Customize table settings dialog and edit available columns, select the settings icon ( ) from the top right of the screen.

Toggle the relevant checkboxes to remove or add a table column. Next, select Apply to confirm your choices.

Manage scheduled queries with inline actions inline-actions

The Scheduled Queries view offers various inline actions to manage all of your scheduled queries from one location. Inline actions are indicated in each row with ellipsis. Select the ellipsis of a scheduled query that you want to manage to see the available options in a pop-up menu. The available options include Disable schedule or Enable schedule, Delete schedule, Subscribe to query alerts, and Enable or Disable quarantine.

Disable or enable a scheduled query disable

To disable a scheduled query, select the ellipsis for the scheduled query you want to manage, then select Disable schedule from the options in the pop-up menu. A dialog appears to confirm your action. Select Disable to confirm your setting.

Once a scheduled query is disabled, you can enable the schedule through the same process. Select the ellipsis, then select Enable schedule from the available options.

Delete a scheduled query delete

To delete a scheduled query, select the ellipsis for the scheduled query you want to manage, then select Delete schedule from the options in the pop-up menu. A dialog appears to confirm your action. Select Delete to confirm your setting.

Once a scheduled query is deleted, it is not removed from the list of scheduled queries. The inline actions provided by the ellipses are removed and replaced by the grayed out add alert subscription icon. You cannot subscribe to alerts for the deleted schedule. The row remains in the UI to provide information on runs conducted as part of the scheduled query.

If you want to schedule runs for that query template, select the template name from the appropriate row to navigate to the Query Editor, then follow the instructions to add a schedule to a query as described in the documentation.

Subscribe to alerts alert-subscription

To subscribe to alerts for scheduled query runs, select either the ... (ellipsis) or alert subscription icon ( ) for the scheduled query you want to manage. The inline actions dropdown menu appears. Next, select Subscribe from the available options.

The Alerts dialog opens. The Alerts dialog subscribes you to both UI notifications and email alerts. There are several alert subscription options available: start, success, failure, quarantine, and delay. Check the appropriate box or boxes and select Save to subscribe.

The table below explains the supported query alert types:

See the alert subscriptions API documentation for more information.

View the query details query-details

Select the information icon ( ) to see the details panel for the query. The details panel contains all the relevant information on the query beyond the facts included in the scheduled queries table. The additional information includes the query ID, the last modified date, the SQL of the query, the schedule ID, and the current set schedule.

Quarantined queries quarantined-queries

When enrolled in the quarantine feature, any scheduled query that fails ten consecutive runs is automatically put into a Quarantined status. A query with this status becomes inactive and does not execute at its scheduled cadence. It then requires your intervention before any further executions can take place. This safeguards system resources as you must review and correct the issues with your SQL before further executions occur.

To enable a scheduled query for the quarantine feature, select the ellipses (...) followed by Enable quarantine from the dropdown menu that appears.

Queries can also be enrolled in the quarantine feature during the schedule creation process. See the query schedules documentation for more information.

Query run delay query-run-delay

Stay in control of your compute hours by setting alerts for query delays. You can monitor query performance and receive notifications if a query’s status remains unchanged after a specific period. Use the ‘Query Run Delay’ alert to be notified if a query continues to process after a specific period of time without completing.

When you subscribe to alerts for scheduled query runs, one of the available alerts is the Query Run Delay. This alert requires you to set a threshold for the time spent executing, at which point you are notified of the delay in processing.

To choose a threshold duration that triggers the notification, either enter a number in the text input field or use the up and down arrows to increase in increments of one minute. Since the threshold is set in minutes, the maximum duration for observing a query run delay is 1440 minutes (24 hours). The default time period for a run delay is 150 minutes.

See the subscribe to alerts section to learn how to subscribe to Query Run Delay alerts.

Filter queries filter

You can filter queries based on run frequency. From the Scheduled Queries tab, select the filter icon ( ) to open the filter sidebar.

To filter the list of queries based on their run frequency, select either the Scheduled or Run once filter checkboxes.

Once you have enabled your filter criteria, select Hide Filters to close the filter panel.

Query runs schedule details query-runs

To open the schedule details page, select a query name from the Scheduled Queries tab. This view provides a list of all the runs executed as part of that scheduled query. The information provided includes the start and end time, status, and dataset used.

This information is provided in a five-column table. Each row denotes a query execution.

Details of the query being scheduled can be seen in the Properties panel. This panel includes the initial query ID, client type, template name, query SQL, and cadence of the schedule.

Select a query run ID to navigate to the run details page and view query information.

Query run overview query-run-overview

The Query run overview provides information on individual runs for this scheduled query and a more detailed breakdown of the run status. This page also includes the client information and details of any errors that may have caused the query to fail.

The query status section provides the error code and error message should the query have failed.

You can copy the query SQL to your clipboard from this view. To copy the query, select the copy icon in the top right of the SQL snippet. A popup message confirms that the code has been copied.

Run details for queries with anonymous block anonymous-block-queries

Queries that use anonymous blocks to comprise their SQL statements are separated into their individual subqueries. The separation into subqueries allows you to inspect the run details for each query block individually.

Anonymous blocks are denoted through the use of a $$ prefix before the query. To find out more about anonymous blocks in query service, see the anonymous block document.

Anonymous block subqueries have tabs to the left of the run status. Select a tab to display the run details.

In the event an anonymous block query fails, you can find the error code for that particular block through this UI.

Select Query to return to the schedule details screen, or Scheduled Queries to return to the Scheduled Queries tab.