Batch ingestion
Learning objectives
In this exercise, you will load the Customer Account data from a file-based source connector to AEP Data Lake and then to Profile. You will learn the following:
- Understanding passthrough mappings
- Fixing ML-generated passthrough mappings
- Using source data preview to check any data quality issues
- Scheduling a dataflow run
- Dealing with errors arising from missing values in required fields
- Dealing with errors arising from data type mismatch errors
- Dealing with data ingest errors and recovering from such failure
- Iteratively using test data to generate a comprehensive mapping set.
NOTE
If you did not complete the Customer Account schema creation in the previous labs, you can browse into the schema catalog and use dep: Customer Account instead
recommendation-more-help
blueprints-learn-help-blueprints