Export of large files from Snowflake fails in Adobe Campaign due to token expiration
Exporting files larger than 30 GB from Snowflake using the FileExport activity in Adobe Campaign workflows fails with the error ODB-240000 ODBC error: Arrow chunk download failed max retries done, caused by authentication token expiration. The token used to download each chunk expires after approximately six hours, preventing completion of lengthy exports.
To fix this, split the export into smaller batches, remove decryption during export, and re-run the workflow with these optimizations.
Description description
Environment
- Product: Adobe Campaign Managed Cloud
- Version: v8, Server Build 8.6.2, Console Build 8.6.2
- Constraints: Production environment; E-MAIL product offering
Issue/Symptoms
- Exporting a file larger than 30 GB from Snowflake fails when using FileExport activity.
- The failure occurs because the authentication token used for downloading each chunk expires after about six hours, preventing completion of long-running exports.
Resolution resolution
- Split the export process into multiple smaller batches so that each batch completes within six hours.
- Remove the two decrypted fields
SmgDecrypt(@birth_date)andSmgDecrypt(@address_street)during export, as decrypting these fields on over 300 million rows significantly increases processing time. - If decryption is required, perform it after the export rather than during the export process.
- Execute the workflow again with these optimizations in place.
- Verify that each batch completes successfully and doesn’t exceed the six-hour processing window.
Notes
- There is no hard-coded file size limit for exports; failures are related to authentication token expiration timing.
- The issue isn’t related to query execution or host whitelisting but to how large dataset downloads are managed via the ODBC driver and Snowflake’s token expiration policy.
- The Snowflake authentication token expires after around six hours.
- Extension of token expiry isn’t possible since this is Snowflake’s internal backend process, which is out of Adobe Campaign’s control.
Related reading
- Get started with Campaign FFDA deployment in Campaign v8 Documentation
- Manage and automate processes with Adobe Campaign workflows in Campaign v8 Documentation
- Import data into Campaign in Campaign v8 Documentation
recommendation-more-help
3d58f420-19b5-47a0-a122-5c9dab55ec7f