Data Hygiene API

The Data Lifecycle UI is built on top of the Data Hygiene API, whose endpoints are available for you to use directly if you prefer to automate your data lifecycle activities. See the Data Hygiene API guide for more information.

Timelines and transparency

Record delete and dataset expiration requests each have their own processing timelines and provide transparency updates at key points in their respective workflows.

The following takes place when a dataset expiration request is created:

StageTime after scheduled expirationDescription
Request is submitted0 hoursA data steward or privacy analyst submits a request for a dataset to expire at a given time. The request is visible in the Data Lifecycle UI after it has been submitted, and remains in a pending status until the scheduled expiration time, after which the request will execute.
Dataset is flagged for deletion0-2 hoursOnce the request is executed, the dataset is flagged for deletion. If using Amazon Web Services (AWS) data storage, this process takes up to two hours. During this time, operations like batch and streaming segmentation, preview or estimate, export, and access disregard this dataset.
Dataset is dropped3 hoursOne hour after the dataset is flagged for deletion, it is fully removed from the system. At this point, the dataset is dropped from the dataset inventory page in the UI. However, the data within the data lake is only soft deleted at this stage and will remain so until the hard deletion process is completed.
Profile count updated30 hoursDepending on the contents of the dataset being deleted, some profiles may be removed from the system if all of their component attributes are tied to that dataset. 30 hours after the dataset is deleted, any resulting changes in overall profile counts are reflected in dashboard widgets and other reports.
Audiences updated48 hoursOnce all affected profiles are updated, all related audiences are updated to reflect their new size. Depending on the dataset that was removed and the attributes that you are segmenting on, the size of each audience could increase or decrease as a result of the deletion.
Journeys and destinations updated50 hoursJourneys, campaigns, and destinations are updated according to changes in related segments.
Hard deletion complete15 daysAll data related to the dataset is hard deleted from the data lake. The status of the data lifecycle job that deleted the dataset is updated to reflect this.
IMPORTANT
Dataset deletions in Amazon Web Services (AWS) are subject to a latency of around three hours before changes are fully applied. This includes up to two hours for the dataset to be flagged for deletion, followed by an additional hour before it is fully dropped from the system. In contrast, deletion requests for Platform instances that use Azure Data Lake result in immediate changes across business functions.
For AWS users, this delay may impact batch segmentation, streaming segmentation, previews, estimates, exports, and data access. This latency only affects customers using AWS, as Azure Data Lake users experience immediate updates. For AWS users, it may take up to three hours for deletion requests to fully propagate through all impacted systems. Adjust your expectations accordingly.

Next steps

This document provided an overview of Platform’s Data Lifecycle capabilities. To get started making data hygiene requests in the UI, refer to the UI guide. To learn how to create Data Lifecycle jobs programmatically, refer to the Data Hygiene API guide


Data Collaboration in Today’s Customer Experience Landscape

Online | Session | General Audience

Reaching audiences where they are is harder than ever, with fewer signals, limited performance insights, and an ever-growing focus on...

Tue, Mar 18, 3:30 PM PDT (10:30 PM UTC)

Register

Elevate and Empower Teams with Agentic AI for Exceptional Experiences

Online | Strategy Keynote | General Audience

Elevate and empower your CX teams with AI that transforms creativity, personalization, and productivity. Discover how Adobe is...

Tue, Mar 18, 1:00 PM PDT (8:00 PM UTC)

Register

Connect with Experience League at Summit!

Get front-row access to top sessions, hands-on activities, and networking—wherever you are!

Learn more