AEP: Data ingestion error due to request payload exceeding maximum allowed size
Adobe Experience Platform (AEP) returns a payload size error when the request exceeds the 1MB limit during streaming ingestion. The system rejects the request and blocks data ingestion. To fix this, reduce the payload size by splitting the data, optimizing the structure, compressing the content, or adjusting batch sizes.
Description description
Environment
Adobe Experience Platform (AEP)
Issue/Symptoms
The following error appears during data ingestion:
Invalid request: The request payload is too large. The maximum accepted size for request payloads is ‘1048576.0 bytes’. Update your request and try again.
This error occurs when the payload exceeds the API limit, causing ingestion failures.
Resolution resolution
Follow these steps to resolve the issue:
- Split large datasets into smaller chunks under 1MB and send them in separate requests instead of uploading everything at once.
- Remove unnecessary fields from the payload to reduce its size.
- Compress the data before sending it using supported methods like
Accept-Encoding: gzip. - Use monitoring tools to track data volume and detect spikes.
- Check for configuration changes made after System Integration Testing (SIT) that increased payload sizes.
- Follow Adobe’s ingestion guardrails by keeping each request payload under 1MB to avoid rejection. Also, ensure individual profile records are no larger than 100KB, as records exceeding this size are automatically dropped during ingestion, even if the overall payload is within limits.
Related reading
- Streaming ingestion overview in AEP Data Ingestion Guide
- Create an HTTP API streaming connection using the UI in AEP Source Connectors Guide
recommendation-more-help
3d58f420-19b5-47a0-a122-5c9dab55ec7f