Guardrails are thresholds that provide guidance for data and system usage, performance optimization, and avoidance of errors or unexpected results in Adobe Experience Platform. Guardrails can refer to your usage or consumption of data and processing in relation to your licensing entitlements.
This document provides guidance on guardrails for data ingestion in Adobe Experience Platform.
The following table outlines guardrails to consider when using the batch ingestion API or sources:
Type of ingestion | Guidelines | Notes |
---|---|---|
Data lake ingestion using the batch ingestion API |
|
|
Data lake ingestion using batch sources |
|
See the sources overview for a catalog of sources you can use for data ingestion. |
Batch ingestion to Profile |
|
|
Number of Profile or ExperienceEvent batches ingested per day | The maximum number of Profile or ExperienceEvent batches ingested per day is 90. This means that the combined total of Profile and ExperienceEvent batches ingested each day cannot exceed 90. Ingesting additional batches will affect system performance. | This is a soft limit. It is possible to go beyond a soft limit, however, soft limits provide a recommended guideline for system performance. |
The following table outlines guardrails to consider when using the streaming ingestion API or streaming sources:
Type of ingestion | Guidelines | Notes |
---|---|---|
Streaming ingestion |
|
Use the batch ingestion API if you require a higher data throughput. |
Streaming sources |
|
Streaming sources such as Kafka, Azure Event Hubs, and Amazon Kinesis do not use the Data Collection Core Service (DCCS) route and can have different throughput limits. See the sources overview for a catalog of sources you can use for data ingestion. |
See the following documentation for more information on data and processing guardrails in Experience Platform: