Debugging errors
Preview error diagnostics
After a few minutes, you should notice that the Status shows a failure. Drill into the failure details to see what caused the failure.
- Click on Dataflow Run Start date
- Click on the Preview error diagnostics to see the specific details on each row that fail
The screen you now see shows you a bunch of details about what the error codes mean with the full error message and the row that failed.
Understanding error types
INGEST-XXXX-XXX error
This error occurs because person.birthDayAndMonth is expected in the format of a two digit month plus a two digit day (i.e. April 27 should be formatted as 04-27)
The value (9-27) does not conform to the specified
regex pattern: [0-1][0-9]-[0-9][0-9] in field:
person.birthDayAndMonth of type: String
MAPPER-XXXX-XXX error
This error occurs because the source field of createDate has string values of Created on 2022-04-22T19:34:17Z. This value cannot be converted into a date automatically because of the text at the beginning: Created on. A calculated field must be used to cleanse the data.
Error transforming data for destination path
_dep.account.createDate. Details: Unable to convert
Created on 2023-09-24T10:19:58Z to schema type DATE_TIME