Configure mapping

NOTE
Only follow this section if you successfully completed the Batch Ingestion lab. Otherwise follow the Mapping Data steps found in the Batch Ingestion lab.

Import mapping set

If you completed the Batch Ingestion lab you can re-use the mapping set you created there 😄🎉

Perform the following steps:

  1. Click on the Import Mapping button on the mapping screen

    Import Mapping button on the mapping screen

  2. Choose the dataflow you created in the Batch Ingestion section and select it. It should be named like Customer Account Batch v2 - <your initials>.

Choosing the Batch Ingestion dataflow to import its mapping set from

After import you are going to see errors appear. This is because the date format used for the birth_Date field in the sample file has changed.

  • Batch Sample file used -> mm/dd/yyyy
  • Stream Sample file used -> yyyy-mm-dd

The calculated fields that use date functions will need to be updated to account for the change in the date format used.

Mapping errors shown after importing the batch ingestion mapping set

Update calculated fields

Update each calculated field by simply clicking on the arrow icon next to each calculated field and then validate your mappings

Arrow icon to click for editing the formula of a calculated field

Target Field
New Calculated Field
person.birthYear
date_part(“yyyy”,date(birth_Date,“yyyy-M-d”))
person.birthDayAndMonth
concat(date_part(“mm”, date(birth_Date, “yyyy-M-d”)).toString(), “-”, date_part(“dd”, date(birth_Date, “yyyy-M-d”)).toString())
recommendation-more-help
blueprints-learn-help-blueprints