Ingestion health checks

The ingestion health check scans your sandbox for batch ingestion volume approaching the platform guardrail for Profile-enabled datasets.

Batches per day (profile) batches-per-day-profile

Scans the combined daily count of Profile and Experience Event batches ingested into a sandbox against the platform guardrail.

Detail
Description
Issue
The combined count of Profile and Experience Event batches ingested into the sandbox in the last 24 hours is approaching the limit of 90 batches per day.
Impact
Exceeding the limit increases processing queue depth in the Profile store, which delays profile updates. Scheduled segmentation runs on its regular schedule regardless of whether all batches finished ingesting, which can lead to incorrect audience results from stale profile data.
Remediation
Consolidate ingestion to no more than one batch per dataset per 24 hours. Refer to the Job Schedules dashboard to identify which datasets need batch count reduction.

When you select the Batches Per Day (Profile) card, a detail panel opens on the right. The panel shows:

  • Description: Explains that the per sandbox, per day limit for profile batch ingestion is 90 batches per day. This check inspects the combined daily count of Profile and Experience Event batches ingested into the sandbox for Profile-enabled datasets against the platform guardrail.
  • Impact: Exceeding 90 Profile or Experience Event batches per day increases processing queue depth in the Profile store, delaying profile updates. Scheduled segmentation starts on schedule regardless of whether all batches have finished ingesting, which can lead to incorrect audience results from stale profile data.
  • General areas of impact: Segmentation and activation results.
  • Experience League Documentation: A link to guardrails for data ingestion.
  • Recommendation: Consolidate ingestion to no more than one batch per dataset per 24 hours. Refer to the Job Schedules dashboard to identify which datasets need batch count reduction.

Batches Per Day (Profile) detail panel showing description, impact, general areas of impact, and Check Passed confirmation {modal="regular"}

For more information, see the guardrails for data ingestion.

Dimension entity batch frequency dimension-entity-batch-frequency

Verifies that dimension entity datasets are not ingested more often than the platform guardrail.

Detail
Description
Issue
One or more dimension entity datasets are ingested more than four times per day.
Impact
Each batch ingested for a dimension entity forces the segmentation engine to reload that entity’s data into memory, disrupting in-flight evaluations and increasing audience evaluation latency for any audience referencing the affected lookup relationship.
Remediation
Consolidate ingestion of the affected dimension entity to four or fewer batches per day.

When you select the Dimension Entity Batch Frequency card, a detail panel opens on the right. The panel shows:

  • Description: Explains that Experience Platform implements a soft guardrail of four batches per entity per day. This check verifies against that guardrail.
  • Impact: Each batch ingested for a dimension entity forces the segmentation engine to reload that entity’s data into memory, disrupting in-flight evaluations and increasing audience evaluation latency for any audience referencing the affected lookup relationship.
  • General areas of impact: Segmentation latency.
  • Experience League Documentation: A link to profile guardrails.

Dimension Entity Batch Frequency detail panel showing description, impact, and general areas of impact {modal="regular"}

For more information, see the profile guardrails.

Data Lake batch ingestion rate data-lake-batch-ingestion-rate

Monitors the sandbox Data Lake batch ingestion rate through both API calls and source connectors.

Detail
Description
Issue
Average hourly Data Lake batch ingestion rate is approaching the 20 GB/h limit for API calls or the 200 GB/h limit for source connectors.
Impact
Exceeding these guardrails causes incoming batches to queue at the Data Lake layer, extending the time for data availability for downstream processing. This includes profile hydration, Query Service queries, audience evaluation, and Customer Journey Analytics reporting.
Remediation
Spread ingestion across a wider time window, or consolidate batches from multiple source connectors to stay within the guardrail.

When you select the Data Lake Batch Ingestion Rate card, a detail panel opens on the right. The panel shows:

  • Description: Explains that batch ingestion into the Data Lake occurs either through API calls or through batch source connectors. If the batches are ingested through API calls, you are allowed to ingest up to 20 GB/hour. If the batches are ingested through source connectors, such as Azure Blob, Amazon S3, or SFTP, you are allowed to ingest up to 200 GB/hour. This check monitors the sandbox Data Lake batch ingestion rate through both API calls and source connectors.
  • Impact: Exceeding these guardrails causes incoming batches to queue at the Data Lake layer, extending the time for data availability for downstream processing. This includes profile hydration, Query Service queries, audience evaluation, and Customer Journey Analytics reporting.
  • General areas of impact: Segmentation, Query Service, and Customer Journey Analytics reporting.
  • Experience League Documentation: A link to ingestion guardrails.

Data Lake Batch Ingestion Rate detail panel showing description, impact, and general areas of impact {modal="regular"}

For more information, see the guardrails for data ingestion.

Next steps next-steps

recommendation-more-help
experience-platform-help-run-and-operate