Snowflake connection timeout when editing Source dataflow in AEP
This article addresses the Snowflake connection timeout issue in Adobe Experience Platform when editing a Snowflake Source dataflow at the Select Data step. The resolution involves identifying and addressing performance bottlenecks in the underlying SQL query and adjusting the warehouse size to improve the query execution time.
Description description
Environment
Adobe Experience Platform (AEP)
Issue/Symptoms
The following error is thrown when editing a Snowflake dataflow at the Select Data step, which blocks you from moving forward with the workflow.
Sample data could not be loaded due to a timeout error that occurred during preview.
You may still view a schema preview, but without sample data. Doing so may result in calculated fields and required fields not being validated at the mapping step, and you will then have to manually validate those fields when mapping.
Upon enabling the Skip previewing sample data toggle, the page loads for a few minutes and throws:
This API call took an extended time to respond, even without data preview. Please optimize the data source or try again later.
Resolution resolution
Follow these steps to troubleshoot the issue:
-
Run the following query directly in Snowflake to check the query execution time:
SELECT * FROM <view/table> LIMIT 100;If this takes more than 30 seconds, it could be the cause of the timeout.
-
If the query is on a View, review the underlying SQL query for performance bottlenecks. Consider optimizing joins, filtering earlier, using materialized views, or indexing where applicable.
-
If the query still takes long, consider increasing the warehouse size in Snowflake temporarily to see if performance improves.
Note: If the warehouse size is changed, ensure the connection/account in AEP Sources UI reflects the update.
Related reading
- Skip preview of sample data in the Source Connectors Guide
- Stream data from your Snowflake database to Experience Platform using the UI