How soon will the dataset retention job delete data from Profile services?
Answer
Once a retention policy is set, existing events are immediately deleted from Experience Platform if their event timestamp exceeds the retention period. New events are deleted once their timestamp surpasses the retention period.
For example, if you apply a 30-day expiration policy on May 15th, the following occurs:
- New events receive a 30-day expiration as they are ingested.
- Existing events with a timestamp older than April 15th are immediately deleted.
- Existing events with a timestamp after April 15th are set to expire 30 days after their timestamp. For instance, an event from April 18th would be deleted on May 18th.
Dataset Usage and Monitoring
How can I check my current dataset usage?
Answer
You can view the latest dataset-level storage size in data lake and Profile as separate metrics on the Datasets inventory page. You can also sort the columns to identify the largest datasets and ensure that retention policies are applied. Sandbox-level usage is available in the License Usage dashboard. Please refer to the License Usage documentation for details.
How can I verify if the data retention job was successful?
Answer
You can check the timestamp of the last data retention job in the Dataset retention configuration UI and on the Datasets inventory page. Reports for historical dataset usage are currently unavailable but are planned for future releases.