Transfer-Control Files for Log File Transfers
Last update: April 4, 2021
- Topics:
- Outbound Data Transfers
Transfer-control (.info) files provide metadata information about file transfers so that partners can verify that Audience Manager handled file transfers correctly.
Audience Manager sends a transfer-control file to a partner with every file transfer. Due to the multi-thread nature of the FTP publisher, the transfer-control file might be sent before the actual files are finished transferring.
The metadata in the .info file lets partners:
- Determine when a full transfer cycle is complete (the total number of files in the sequence have been delivered);
- Determine whether any given file in the sequence is complete/correct (by examining the size of the file in bytes and the total number of lines);
- Validate the number of rows in raw files verses the number of rows after the files have been loaded in the database on the receiving end (size of file in lines).
File Naming Conventions
The transfer-control file has the same name as the root of the batch/sequence with a .info file extension.s
For example, if the first file in the sequence were named: ftp_12345_67890_full_1500727351632-1.sync, the control file would be named ftp_12345_67890_iter_1500727351632.info.
File Format
{
Files: [
{
FileByteSize: 293029329,
FileLineCount: 36893908,
FileName: "ftp_12345_67890_full_1500727351632-1.sync.gz",
FileSequenceNumber: 1,
md5: "983g634be2ad5263c6a6c4958bf61d9f"
},
{
FileByteSize: 293039238,
FileLineCount: 36895184,
FileName: "ftp_12345_67890_full_1500727351632-2.sync.gz",
FileSequenceNumber: 2,
md5: "6sn9907c8e78cfd78409622e7b55a984"
},
{
FileByteSize: 293050833,
FileLineCount: 36896787,
FileName: "ftp_12345_67890_full_1500727351632-3.sync.gz",
FileSequenceNumber: 3,
md5: "7cdfb8e74cd6cec1jy6vel21ccb4a962"
},
{
FileByteSize: 218425764,
FileLineCount: 27498226,
FileName: "ftp_12345_67890_full_1500727351632-4.sync.gz",
FileSequenceNumber: 4,
md5: "7hs53149f8a2444457g968f04cbbdee5"
}
],
Totals: {
FileName: "ftp_12345_67890_full_1500727351632.sync",
TotalByteSize: 1097545164,
TotalNumberFiles: 4,
TotalNumberLines: 138184105
}
}
The batch total numbers are exclusive of the .info file itself. That is, the totals do not include the .info file, its byte size, or its line count.
Byte sizes of files and line counts are inclusive of any header and spacer (blank) lines/rows. In order to get the count of actual data lines/rows, subtract headers.
Total lines in batch and total byte size are inclusive of any header and space rows.
Previous pageOutbound Data File Name: Syntax and Examples
Next pageOutbound Template Macros
Audience Manager
- Audience Manager Guide
- Evolution guide to Real-Time CDP
- Migrate to Web SDK
- Overview
- Features
- Addressable Audiences
- Administration
- Algorithmic Models
- Audience Lab
- Audience Marketplace
- Customer Data Feeds
- Data Explorer
- Data Export Controls
- Data Sources
- Declared IDs
- Derived Signals
- Destinations
- Destinations Overview
- Destinations Home Page
- Adobe Experience Cloud Destinations
- People-Based Destinations
- Device-Based Destinations (Server-to-Server)
- Custom Destinations
- Destinations Reference
- Profile Merge Rules
- Profile Merge Rules Overview
- Getting Started with Profile Merge Rules
- Profile Merge Rules Dashboard
- Profile Merge Rule Options Defined
- General Use Cases for Profile Merge Rules
- Profile Link Device Graph Use Cases
- External Device Graph Use Cases
- Report Metrics for Profile Merge Rules
- Profile Merge Rules and Device Un-Segmentation Processes
- Instant Cross-Device Suppression
- Segments
- Segments: Purpose, Composition, and Rules
- Segments List View
- Segment Summary View
- Retrieving Segment Metadata
- Paused and Deleted Segments
- Recency and Frequency
- Segment Builder
- Code Syntax Used in the Segment Expression Editor
- Trait and Segment Population Data in Segment Builder
- Trait Recommendations
- Trait and Segment Qualification Reference
- Traits
- Traits Overview
- Trait Details Page
- Traits Dashboard
- Active Audience Traits and Data Source Synced Traits
- Folder Traits: About
- Manage Folder Traits
- Trait Builder
- Trait Storage
- Accuracy and Reach
- Classifying Traits with a Common Taxonomy
- Name Requirements for Key Variables
- Segment and Trait Time-to-Live Explained
- Prefix Requirements for Key Variables
- Geotargeting With Platform-level Keys
- Device Targeting With Platform-level Keys
- Sample Expressions With Boolean and Comparison Operators
- Trait and Segment Qualification Reference
- Visitor Profile Viewer
- Reporting
- Reports Overview
- Reports Dashboard
- General Reports
- Trend Reports
- Audience Optimization Reports
- Interactive and Overlap Reports
- Interactive and Overlap Reports Overview
- Trait-to-Trait Overlap Report
- Segment-to-Trait Overlap Report
- Segment-to-Segment Overlap Report
- Unused Signals Report
- Improve Log File Processing Times with Lookup Tables
- Filter Report Results With the Data Sliders
- Overlap Reports: Update Schedule and Minimum Segment Size
- CSV Files for Overlap Reports
- Report Technology
- Onboarding Status Report
- Outbound File History
- Counting Unique Users in Overlap and General Reports
- Data Sampling and Error Rates in Selected Audience Manager Reports
- API and SDK Code
- API and SDK Code Overview
- Audience Manager API Code Migration
- Data Collection Server (DCS) API Methods and Code
- REST APIs
- REST APIs Overview
- Getting Started with REST APIs
- Algorithmic API Methods
- Data Integration Library API Methods
- Data Source API Methods
- Derived Signals API Methods
- Destination API Methods
- Domain Management API Methods
- Folder API Methods
- Segment API Methods
- Taxonomic API Methods
- Trait API Methods
- Trait Type Methods
- User, Group, and Permissions Management API Methods
- DCS Region API Methods
- SDK Code
- Data Integration Library (DIL) API
- Implementation and Integration Guides
- Implementation and Integration Guides
- Data Integration Methods
- Integrate Google Ad Manager using Google Publisher Tags (GPT)
- Integrating with Third-Party Destinations
- Implementing Audience Manager
- Media Data Integration
- Receiving Audience Data
- Sending Audience Data
- Sending Audience Data
- Real-Time Inbound Data Integration
- Batch Data Transfer Process
- Batch Data Transfer Process Described
- Send Batch Data to Audience Manager Overview
- ID Synchronization for Inbound Data Transfers
- Name and Content Requirements for ID Synchronization Files
- Inbound Data File Contents: Syntax, Invalid Characters, Variables, and Examples
- Amazon S3 Name and File Size Requirements for Inbound Data Files
- FTP Name and File Size Requirements for Inbound Data Files
- File PGP Encryption for Inbound Data Types
- File Compression for Inbound Data Transfer Files
- Sample Message to Partners after Inbound Processing
- Leverage Amazon S3 Cross-Account Bucket Permissions for Your Inbound Files
- Custom Partner Integrations
- Integration with Adobe Experience Platform
- Integration with Other Experience Cloud Applications
- Reference
- Reference Overview
- Amazon S3: About
- Advertiser Use Cases
- Publisher Use Cases
- Beta Environment
- Boolean Expressions in Trait and Segment Builder
- Bulk Management Tools
- CID Replaces DPID and DPUUID
- How Data Delivery and File Processing Times Affect Reports
- Index of IDs in Audience Manager
- Key-Value Pairs Explained
- Password Requirements, Locked Accounts, and Forgotten Passwords
- Signals, Traits, and Segments
- Supported Browsers
- System Components
- Style Conventions for Code and Text Elements
- Time Zones in Audience Manager
- TLS 1.0 and 1.1 Deprecation
- Understanding Calls to the Demdex Domain
- Visitor Authentication States in Audience Manager
- FAQs
- Audience Manager FAQ Overview
- API FAQ
- Audience Lab FAQ
- Customer Data Feed FAQ
- Data Collection and Product Integration FAQ
- Inbound Customer Data Ingestion FAQ
- Privacy and Data Retention FAQ
- People-Based Destinations FAQ
- Product Features and Functions FAQ
- Profile Merge Rules and Device Graph FAQ
- Look-Alike Modeling FAQ
- Predictive Audiences FAQ
- Targeting FAQ
- Reporting FAQ
- Help and Legal
- Top Customer Support Issues
- Overview
- Why did my Onboarded trait populations drop to 0 around October 15th?
- Why do my traits or segments not show up in the Overlap Reports page?
- Why are our Read-Only users able to create, edit or delete traits and segments?
- We are not an Audience Manager customer, but see the Audience Manager Javascript calls on our site
- Should I see my Audience Manager Audience Lab mapped segments on the destination details page?
- Documentation Updates
- Glossary