Log Processing Dataset Include Files

IMPORTANT

Read more about Data Workbench’s End-of-life announcement.

The Log Processing Dataset Include file for an inherited profile contains parameters associated with the log processing phase of dataset construction.

The first line of a Log Processing Dataset Include file defines a type LogProcessingInclude that supports the Decoder Groups, Fields, Log Entry Condition, Parameters, Reprocess, Stage, and Transformations parameters. All other parameters for log processing must be defined in the Log Processing.cfg file in the dataset profile’s Dataset directory. You can name a Log Processing Dataset Include file anything you want, but its file extension must be .cfg. The file must be stored within the inherited profile name\Dataset\Log Processing directory. Because the files are loaded recursively during the log processing phase of dataset construction, you can store the Log Processing Dataset Include files at any level within the directory (for example, inherited profile name\Dataset\Log Processing*folder name**include file name*.cfg).

NOTE

Many web-specific configuration parameters for Site are defined in Log Processing Dataset Include files. For information about these parameters, see Configuration Settings for Web Data.

Parameter Description
Decoder Groups

Required if you have defined log file or XML file log sources in the Log Processing.cfg file. The text file or XML decoders that you define to extract fields of data from log file and XML log sources.

To add a new decoder group

  • Right-click Decoder Group and click Add new > TextFileDecoderGroup or XMLDecoderGroup.
  • In the Name parameter for the new group, enter the desired name of the decoder group.

Note: When you specify a Decoder Group in the Log Processing.cfg file for the dataset profile, the name must match exactly the name that you enter here. For more information, see Log Files.

For information about the decoders that you can define for each group, see Text File Decoder Groups or XML Decoder Groups.

Fields

Lists fields that are defined in Log Sources or Transformations in a Log Processing Dataset Configuration file but used in transformations, conditions, or extended dimensions in a Transformation Dataset Configuration file must be listed here.

Each field below must be listed in some Log Processing Dataset Include file:

  • x-trackingid
  • x-timestamp

Log Entry Condition

Optional. Defines the rules by which log entries are considered for inclusion in the dataset. See Log Entry Condition.

Note: To be included in the dataset, a log entry must satisfy the Log Entry Condition in the Log Processing.cfg file and in every Log Processing Dataset Include file.

Parameters Optional. A variable that you can reference in other configuration parameters. For more information, see Defining Parameters in Dataset Include Files.
Reprocess

Optional. Any character or combination of characters can be entered here. Changing this parameter and saving the file to the data workbench server initiates data reprocessing.

For information about reprocessing your data, see Reprocessing and Retransformation.

Stage

Optional. The name of the processing stage that applies to this Log Processing Dataset Include file. The processing stages are defined in the Stages parameter in the Log Processing.cfg file.

Note: When you specify a Stage, the name of the Stage must match exactly the name that is listed in the Stages parameter in the Log Processing.cfg file for the dataset profile.

Transformations Optional. Defines the data transformations that need to be applied during log processing. For information about the available transformation types, see Data Transformations.
NOTE

For descriptions of the parameters in the Log Processing.cfg file, see Log Processing Configuration File.

You should keep the following points in mind whenever you are working with Log Processing Dataset Include files:

  • Changing any of the parameters in this file requires reprocessing of all of the data.
  • You can add any of the parameters described above to the Log Processing Dataset Include file by opening and editing the file in Notepad. Any changes you make and save appear when you reopen the file in data workbench. When adding a new parameter, use the Space key (not the Tab key) to indent two (2) spaces to the right of the previous heading level.

Business.Adobe.com resources

Docs links
Custom Variables Third Party Data Lookalike Modeling Target Market Segmentation Marketing Analytics Web Analytics

On this page