Read more about Data Workbench’s End-of-life announcement.
The Log Processing Dataset Include file for an inherited profile contains parameters associated with the log processing phase of dataset construction.
The first line of a Log Processing Dataset Include file defines a type LogProcessingInclude that supports the Decoder Groups, Fields, Log Entry Condition, Parameters, Reprocess, Stage, and Transformations parameters. All other parameters for log processing must be defined in the Log Processing.cfg file in the dataset profile’s Dataset directory. You can name a Log Processing Dataset Include file anything you want, but its file extension must be .cfg. The file must be stored within the inherited profile name\Dataset\Log Processing directory. Because the files are loaded recursively during the log processing phase of dataset construction, you can store the Log Processing Dataset Include files at any level within the directory (for example, inherited profile name\Dataset\Log Processing*folder name**include file name*.cfg).
Many web-specific configuration parameters for Site are defined in Log Processing Dataset Include files. For information about these parameters, see Configuration Settings for Web Data.
Parameter | Description |
---|---|
Decoder Groups | Required if you have defined log file or XML file log sources in the Log Processing.cfg file. The text file or XML decoders that you define to extract fields of data from log file and XML log sources. To add a new decoder group
Note: When you specify a Decoder Group in the Log Processing.cfg file for the dataset profile, the name must match exactly the name that you enter here. For more information, see Log Files. For information about the decoders that you can define for each group, see Text File Decoder Groups or XML Decoder Groups. |
Fields | Lists fields that are defined in Log Sources or Transformations in a Log Processing Dataset Configuration file but used in transformations, conditions, or extended dimensions in a Transformation Dataset Configuration file must be listed here. Each field below must be listed in some Log Processing Dataset Include file:
|
Log Entry Condition | Optional. Defines the rules by which log entries are considered for inclusion in the dataset. See Log Entry Condition.
Note: To be included in the dataset, a log entry must satisfy the Log Entry Condition in the Log Processing.cfg file and in every Log Processing Dataset Include file. |
Parameters | Optional. A variable that you can reference in other configuration parameters. For more information, see Defining Parameters in Dataset Include Files. |
Reprocess | Optional. Any character or combination of characters can be entered here. Changing this parameter and saving the file to the data workbench server initiates data reprocessing. For information about reprocessing your data, see Reprocessing and Retransformation. |
Stage | Optional. The name of the processing stage that applies to this Log Processing Dataset Include file. The processing stages are defined in the Stages parameter in the Log Processing.cfg file.
Note: When you specify a Stage, the name of the Stage must match exactly the name that is listed in the Stages parameter in the Log Processing.cfg file for the dataset profile. |
Transformations | Optional. Defines the data transformations that need to be applied during log processing. For information about the available transformation types, see Data Transformations. |
For descriptions of the parameters in the Log Processing.cfg file, see Log Processing Configuration File.
You should keep the following points in mind whenever you are working with Log Processing Dataset Include files: