Guardrails are thresholds that provide guidance for data and system usage, performance optimization, and avoidance of errors or unexpected results in Adobe Experience Platform. Guardrails can refer to your usage or consumption of data and processing in relation to your licensing entitlements.
This document provides guidance on guardrails for data ingestion in Adobe Experience Platform.
The following table outlines guardrails to consider when using the batch ingestion API or sources:
Type of ingestion | Guidelines | Notes |
---|---|---|
Data lake ingestion using the batch ingestion API |
|
|
Data lake ingestion using batch sources |
|
See the sources overview for a catalog of sources you can use for data ingestion. |
Batch ingestion to Profile |
|
|
Number of Profile or ExperienceEvent batches ingested per day | The maximum number of Profile or ExperienceEvent batches ingested per day is 90. This means that the combined total of Profile and ExperienceEvent batches ingested each day cannot exceed 90. Ingesting additional batches will affect system performance. | This is a soft limit. It is possible to go beyond a soft limit, however, soft limits provide a recommended guideline for system performance. |
Read the streaming ingestion overview for information on guardrails for streaming ingestion.
The following table outlines guardrails to consider when using the streaming sources:
Type of ingestion | Guidelines | Notes |
---|---|---|
Streaming sources |
|
Streaming sources such as Kafka, Azure Event Hubs, and Amazon Kinesis do not use the Data Collection Core Service (DCCS) route and can have different throughput limits. See the sources overview for a catalog of sources you can use for data ingestion. |
See the following documentation for more information on other Experience Platform services guardrails, on end-to-end latency information, and licensing information from Real-Time CDP Product Description documents: