Describes the required fields, syntax, naming conventions and file sizes you need to follow when sending data to Audience Manager. Set the names and sizes of your files according to these specifications when you send data to an Audience Manager / Amazon S3 directory.
The text styles (monospaced text
, italics, brackets [ ]
( )
, etc.) in this document indicate code elements and options. See Style Conventions for Code and Text Elements for more information.
S3 file names contain the following required and optional elements:
S3 prefix: s3n://AWS_directory/partner_name/date=yyyy-mm-dd/
File name elements: ftp_dpm_DPID[_DPID_TARGET_DATA_OWNER]_TIMESTAMP(.sync|.overwrite)[.SPLIT_NUMBER][.gz]
For other accepted file name formats, see Custom Partner Integrations.
Audience Manager only processes ASCII and UTF-8 encoded files.
The table defines the elements in an S3 file name.
Name Element | Description |
---|---|
|
The path to and name of your Amazon S3 bucket. Contact your Account Manager for your S3 directory name, path, and credentials. |
|
A timestamp (based on UTC time) of when you send the files to your S3 bucket. |
|
An lD that tells Audience Manager if a data file contains your own user IDs, Android IDs, iOS IDs, or other IDs belonging to global data sources. Accepts the following options:
Note: Do not mix ID types in your data files. For example, if your file name includes the Android identifier, don't put iOS IDs or your own IDs in the data file. |
|
This field tells Audience Manager which data source to onboard data to. This field is mandatory if you set the DPID to an Android ID or iOS ID or another ID belonging to global data sources. This lets Audience Manager link the file data back to your organization. Important note: You do not need to request a mapping for existing data sharing relationships (for target data sources belonging to other companies into which you onboarded data prior to March 14, 2022). The mapping is also not required when onboarding data into target data sources that belong to your PID. For example:
|
|
The company or organization name you use in Audience Manager. |
|
A 10-digit, UTC UNIX timestamp in seconds. The timestamp helps make each file name unique. |
|
Synchronization options that include:
|
|
An integer. Used when you split large files into multiple parts to improve processing times. The number indicates which part of the original file you're sending in. For efficient file processing, split your data files as indicated:
See the first 2 file name examples below. |
|
When sending files to Amazon S3, use gzip compression only. When compressed, these files get the Compressed files must be 3 GB or smaller. If your files are larger, please talk to Customer Care. Although Audience Manager can handle large files, we may be able to help you reduce the size of your files and make data transfers more efficient. See File Compression for Inbound Data Transfer Files. |
The following examples show properly formatted file names. Your file names could look similar.
s3n://<AWS_Bucket>/<partner_name>/date=2016-05-09/ftp_dpm_478_1366545717.sync.1.gz
s3n://<AWS_Bucket>/<partner_name>/date=2016-05-09/ftp_dpm_478_1366545717.sync.2.gz
s3n://<AWS_Bucket>/<partner_name>/date=2016-05-09/ftp_dpm_478_1366545717.sync
s3n://<AWS_Bucket>/<partner_name>/date=2016-05-09/ftp_dpm_478_567_1366545717.sync.gz
s3n://<AWS_Bucket>/<partner_name>/date=2016-05-09/ftp_dpm_478_1366545717.overwrite
You can download the sample file if you want additional examples. This file has been saved with the .overwrite
file extension. Open it with a simple text editor.
Consider the figures below for fastest/earliest processing of your files as well as for file size limitations when you send data to an Audience Manager / Amazon S3 directory.
File Type | Optimal Size | Maximum Size |
---|---|---|
Compressed | 200-300 MB |
3 GB |
Uncompressed | 1 GB |
5 GB |
The inbound data validation process will mark empty files as invalid and will not process them.
Inbound data files have a line length limit of 102400 bytes. Lines exceeding this limit are excluded from the transfer.