Multiple runs of scheduled queries in AEP Query Service
When you configure a scheduled query in Adobe Experience Platform (AEP) Query Service, multiple executions of the same query appear within a single scheduled interval, such as one hour, even though only one schedule exists. This behavior occurs due to internal task-level retries when a query fails, not because the schedule triggers multiple times. To resolve the issue, ensure scheduled queries complete successfully without intentional failures.
Description description
Environment
Adobe Experience Platform (AEP) - Query Service
Issue/Symptoms
- A scheduled query configured to run hourly executes multiple times within the same hour.
- Multiple executions appear after the query fails due to custom logic that intentionally triggers a failure.
- Repeated query runs appear within approximately 15-minute intervals instead of a single scheduled execution.
Resolution resolution
- Review the query logic and remove any intentional failure triggers (for example, functions that abort execution when specific conditions are met).
- Update the query to complete successfully when there is no new data to process, instead of failing by design.
- Save the changes and redeploy the updated query.
- Monitor scheduled executions in the UI and confirm that only one run starts per scheduled interval.
- Verify that failed runs and unnecessary retries no longer appear for each scheduled interval.
Notes:
- The multiple runs occur because the orchestration layer triggers Airflow task-level retries (default retries=3).
- Each retry submits a new execution, which appears as a separate run in the UI.
- If a job fails (for example, due to custom error handling), the platform triggers these retries automatically.
- There is no public configuration to adjust or disable these internal retries; the platform manages them and does not expose end-user control.
3d58f420-19b5-47a0-a122-5c9dab55ec7f