Automatic mapping failure on boolean fields during data ingestion
Description description
Environment
Adobe Experience Platform
Issue/Symptoms
In this example, a CRM data ingestion includes the client’s flow with the customers’ master record. The record includes boolean flags about the customers’ privacy consents.
-
The ingestion process is based on a batch import from an S3 bucket.
-
On the CRM side, such fields can arrive as integers (0,1) or as strings (“0”, “1”).
-
When ingesting the data, all the boolean type fields have been imported in the target dataset as “FALSE”, irrespective of the original fields containing integer value 1 or string value “1”.
Expected behaviour:
- The schema-based import from an S3 bucket should properly map integer 1 and string “1” to “TRUE” boolean value.
Resolution resolution
Boolean 0 or 1 is not supported. You would need to use the mapper functions to convert this to boolean values.
recommendation-more-help
3d58f420-19b5-47a0-a122-5c9dab55ec7f