Delete unwanted profiles resulting from data ingestion error from Adobe Experience Platform
In this article, we address how to delete unwanted profiles from Adobe Experience Platform due to a data ingestion error. Learn to identify and remove erroneous profiles while keeping the correct ones, ensuring data accuracy.
Description description
Environment
- Product: Adobe Experience Platform (AEP)
- Component: Real-Time Customer Data Platform (RTCDP)
Issue/Symptoms
An incorrect dataset containing unwanted profile records was batch-uploaded into the RT-CDP. You need to delete these erroneous profiles while retaining the correct ones.
Resolution resolution
There are multiple approaches to resolve this issue:
1. Copy and delete method
-
Use Query Service to select, extract, and copy desired profiles into a new profile-enabled dataset. For steps, refer to Output Datasets in the Query Service Guide in Adobe Experience Platform Documentation.
- Alternatively, export the existing dataset to cloud storage, and cleanse it by removing unwanted records. For steps, refer to Export datasets to cloud storage destinations in the Destinations Guide in Adobe Experience Platform Documentation. Then re-ingest cleaned data back into a new profile-enabled dataset. For steps, refer to Ingest data into Adobe Experience Platform in the Data Ingestion Guide in Adobe Experience Platform Documentation.
-
Once copying is complete, delete the original dataset that contains unwanted profiles.
- This will also delete respective profiles associated with that dataset.
- The deletion process may take around 15 days.
- Historical data from other datasets, events, identity maps, etc., will remain intact for retained profiles.
-
Proceed with deleting the old problematic dataset once all necessary data has been transferred successfully. At this stage, only the new/correct data will be present in the Unified Profile Service (UPS). For steps, refer to Delete datasets and batches in Tutorials in Adobe Experience Platform Documentation.
2. Data lifecycle management
- Utilize Data Lifecycle features if part of Record Beta or have access through your license:
- Contact your Adobe Account team if options like delete record are greyed out in your interface.
NB: Privacy Service should not be used to cleanse erroneous data. As a reminder, you can use Privacy Service only to submit requests to access and delete personal customer data from Adobe Experience Cloud applications, facilitating automated compliance with legal and organizational privacy regulations.
By following these steps or utilizing appropriate APIs/features based on licensing capabilities, you can effectively manage and rectify issues related to uploading incorrect datasets in AEP’s RTCDP environment.