AEP - Unable to connect a to Big Query as a Data Source when adding data

Description

We have been trying to connect our Production instance to a Big Query table and we are presented with an error -“An error occurred getting data from the source”

Existing dataflows are successfully running.

Adding new data seems the issue.

Resolution

The issue is in the Microsoft DataFactory API which takes a long time to fetch list of tables if there are a large number of datasets in GBQ project. The fix for this was done by Microsoft but it appears that they released it only for affected customers at the time of the report. Adobe Engineering is currently communicating with Microsoft for the fix to be released for all. If facing this issue from the Adobe Experience Platform perspective, please raise a support ticket with the AEP team.

On this page