Streaming ingestion for Adobe Experience Platform provides users a method to send data from client and server-side devices to Experience Platform in real time.
Adobe Experience Platform enables you to drive coordinated, consistent, and relevant experiences by generating a Real-time Customer Profile for each of your individual customers. Streaming ingestion plays a key role in building these profiles by enabling you to deliver Profile data into the Data Lake with as little latency as possible.
The following video is designed to help support your understanding of streaming ingestion, and outlines the concepts above.
With streaming ingestion, users can stream profile records and ExperienceEvents to Platform in seconds to help drive real-time personalization. All data sent to streaming ingestion APIs is automatically persisted in the Data Lake.
Please read the create a streaming connection guide for more information.
Once you are confident that your data is clean, you can enable your datasets for Real-time Customer Profile and Identity Service.
For more information on enabling a dataset for Profile and Identity Service, please read the configure a dataset guide.
|Real-time Customer Profile||< 1 minute|
|Data Lake||< 60 minutes|
The table below displays guidance on the request per seconds limits for streaming ingestion.
|1000 requests per second||These can contain multiple messages when using
|10000 individual messages per second||The messages can be grouped into fewer actual requests when using the
The enforced limit becomes 60 requests per minute when using synchronous validation as it is intended for debugging purposes.
You can use the Adobe Experience Platform extension to create a new streaming connection. The Experience Platform extension provides actions to send beacons formatted in Experience Data Model (XDM) for real-time ingestion to Experience Platform. Visit the Experience Platform Extension documentation for more information.