Export of large files from Snowflake fails in Adobe Campaign due to token expiration

Exporting files larger than 30 GB from Snowflake using the FileExport activity in Adobe Campaign workflows fails with the error ODB-240000 ODBC error: Arrow chunk download failed max retries done, caused by authentication token expiration. The token used to download each chunk expires after approximately six hours, preventing completion of lengthy exports.

To fix this, split the export into smaller batches, remove decryption during export, and re-run the workflow with these optimizations.

Description description

Environment

  • Product: Adobe Campaign Managed Cloud
  • Version: v8, Server Build 8.6.2, Console Build 8.6.2
  • Constraints: Production environment; E-MAIL product offering

Issue/Symptoms

  • Exporting a file larger than 30 GB from Snowflake fails when using FileExport activity.
  • The failure occurs because the authentication token used for downloading each chunk expires after about six hours, preventing completion of long-running exports.

Resolution resolution

  1. Split the export process into multiple smaller batches so that each batch completes within six hours.
  2. Remove the two decrypted fields SmgDecrypt(@birth_date) and SmgDecrypt(@address_street) during export, as decrypting these fields on over 300 million rows significantly increases processing time.
  3. If decryption is required, perform it after the export rather than during the export process.
  4. Execute the workflow again with these optimizations in place.
  5. Verify that each batch completes successfully and doesn’t exceed the six-hour processing window.

Notes

  • There is no hard-coded file size limit for exports; failures are related to authentication token expiration timing.
  • The issue isn’t related to query execution or host whitelisting but to how large dataset downloads are managed via the ODBC driver and Snowflake’s token expiration policy.
  • The Snowflake authentication token expires after around six hours.
  • Extension of token expiry isn’t possible since this is Snowflake’s internal backend process, which is out of Adobe Campaign’s control.
recommendation-more-help
3d58f420-19b5-47a0-a122-5c9dab55ec7f