About the Log Processing Configuration File

Data Workbench Help
End-of-life announcement
Release notes
- Release Notes Overview
- Data Workbench 6.74 Release Notes
- Data Workbench 6.73 Release Notes
- Data Workbench 6.72 Release Notes
- Data Workbench 6.7 Release Notes
- Data Workbench Report Portal 2.1
- Data Workbench 6.61 Release Notes
- Data Workbench 6.6 Release Notes
- Data Workbench 6.52 Update
- Data Workbench 6.51 Update
- Data Workbench 6.5 Release Notes
- Data Workbench 6.4 Release Notes
- Data Workbench 6.31 Update
- Data Workbench 6.3 Release Notes
- Data Workbench 6.21 Update
- Data Workbench 6.2 Release Notes
- Data Workbench 6.11 Update
- Data Feeds Update for April MR 2014
- Data Workbench 6.1 Release Notes
- Data Workbench 6.0 and 6.0.4 Release Notes
Installation
- Workstation requirements
- Workstation setup
- Upgrading Data Workbench
Client
- Opening Data Workbench
- Self-provisioning of users
- Working offline and online
- Profiles
- Worktops
- File versioning
- Using the Worktop thumbnail menu
- Configure the sidebar
- Display workspaces
  - Display workspaces overview
  - Display a workspace
  - Create a workspace
  - Workspace File menu
  - Refit a workspace
  - Share a workspace
  - Save a workspace
  - Export a workspace
  - Import a workspace
  - Add a description to a workspace
  - Unlocking a workspace
  - Deleting a workspaces
  - Using the workspace Window menu
- Keyboard shortcuts for the Data Workbench Client
- Working with windows in a workspace
  - Working with windows in a workspace overview
  - Manipulate windows in a workspace
  - Work with text in windows
  - Window Controls menu
  - Export window data
- Exporting data
  - Exporting data using segment export
  - Segment export
  - Output format
  - Configure segments for export
  - Create dimensions for use with segment export
  - Segment Export with Custom Headers
  - Export a segment using S/FTP delivery
  - Profiles and Audiences Export
  - Exporting to Analytics Core Services
  - Export to Adobe Target
  - Segment export wizard
- Analytics Reports
- Attribution reports
  - Using attribution reports
  - Attribution Profile Overview
  - Deploying the Attribution Profile
  - Attribution Models
  - Best Fit Attribution
  - Build a Best Fit Attribution Model
- Visualizations
  - Visualizations overview
  - Opening visualizations
  - Quick reference
  - Make selections
  - Benchmarks
  - Metric and dimension menus
  - Subsets
  - Zoom in or out in a visualization
  - Adding callouts to a workspace
  - Annotating visualizations
  - Add a bookmark
  - Metric Dim Wizard
  - Editing the Metric Dim
- Analysis visualizations
  - Analysis visualizations overview
  - 2D scatter plots
  - 3D Scatter Plots
  - Annotations
    - Annotations overview
    - Text annotations
    - Image annotations
    - Dynamic title annotations
  - Association Chord visualization
  - Association Table visualization
  - Visitor Clustering
    - Visitor Clustering Overview
    - Clustering 2.0
    - Building Clusters
    - Exploring Clusters
  - Chord Visualization
  - Correlation Matrix
    - Correlation Matrix Overview
    - About the Pearson Correlation Coefficient
    - Correlation Analysis Use Cases
    - Binary Filter in the Correlation Matrix
  - Decision Tree Builder
    - Decision Tree Builder Overview
    - Building a Decision Tree
    - Decision Tree Options
    - Regression tree option for decision tree
  - Density Map
  - Detail table
  - Filter editors
    - Filter editors overview
    - Working with filter conditions
    - Save and load filters
    - Edit filter files manually
    - Apply a filter to a workspace
  - Funnel Visualization
    - Funnel Visualization Overview
    - Funnel Features
    - Building a Funnel
    - Adding a Path Browser
  - Globes
    - Globes overview
    - Working with globes
    - Display layers
    - Make selections on a globe
  - Graphs
    - Graphs overview
    - Add and change a metrics
    - Change a dimension
    - Change a graph display
    - Change a series
    - Regression Analysis Graph
    - Trend Lines
    - 2D graphs
  - Guided analysis
    - Guided analysis overview
    - Statistical measures
    - Display the Dimension menu
  - Latency Analysis
  - Latency tables
  - Legends
    - Legends overview
    - Color legends
    - Confidence legends
    - Metric legends
    - Value legends
  - Path browsers
    - Path browsers
    - Creating path browsers
    - Display metric information
    - Extend a paths
    - Display the start and end of paths
    - Change the path browser’s root
    - Select a path
    - View more elements in paths
  - Pie Chart
  - Process map
    - Process map overview
    - Types of process maps
    - Create a process map
    - Move and rotate a process map
    - Select a node
    - Move a node
    - Remove a node
    - Label a node
    - Make a selection from a process map
    - Save a dimension from a process map
    - Create a visualization from a process map
    - Activate a color link
    - Display a metric quantity
    - Add a callout
  - Propensity Scoring
    - Propensity Scoring Overview
    - Setting up Propensity Scoring
    - Calculating Propensity Scoring
    - Propensity Gain and Lift Charts
    - Model Viewer
    - Complex Filter Description
  - Radar visualization
  - Statistical display in tables
  - Segments
    - Segments overview
    - Create a segment dimensions
    - Reusing a segment visualization
  - Tables
    - Tables overview
    - Add and change a metric
    - Add, change, and move a dimension
    - Fit data to a window
    - Change the table display
    - Sort data in a table
    - Mask data
    - Enable a series legend
    - Open a URI from a table
    - Apply hierarchy views
    - Export to Microsoft Excel
    - Export to a TSV file
  - Work with data in worksheets
  - Worksheets
    - Worksheets overview
    - Worksheet expressions
    - Create a metric indicator
    - Create an input cell
    - Use callouts with worksheets
    - Export to Microsoft Excel
- Imagery layers
  - About imagery layers
  - Terrain image layers
  - Element point layers
  - Working with vector layers
- Administrative interfaces
  - Administrative interfaces
  - Open administrative interfaces
  - Dataset Schema interface
  - Query Status Legend
  - Query Queue
  - Processing Legend
  - Detailed Status interface
  - Profile Manager
  - Dataset managers
  - Servers Manager
  - Remote desktop option
  - Server Files Manager
  - Server Monitor interface
  - Configuration option
- Interface and analysis features
  - Interface and analysis features
  - Customize Data Workbench locally
  - Customize menus
  - Customize the profile manager and server file manager
  - Customize a worktop tab
  - Setting up Localized Languages
  - Configure a locked workspace
  - Configure open functionality
  - Configure a callout
  - Configure a latency table
  - Create a latency dimension
  - Configure a page overlay
  - Configure a path browser
  - Configure a process map
  - Configure the Dataset Schema Interface
  - Localizing Time Dimensions
- Configuration parameters
- Query language syntax
  - Query language syntax
  - Syntax for any expression
  - Syntax for identifiers
  - Syntax for metric expressions
  - Syntax for dimension expressions
  - Syntax for filter expressions
  - Syntax for math expressions
  - Statistical Callouts
  - Regular expressions
Dataset configuration
- Understanding Dataset Construction
- Understanding Dataset Configuration
- Data Workbench Support for GDPR
- Log Processing Configuration File
- Transformation Configuration File
- Dataset Include Files
- Additional Configuration Files
- Data Transformations
- Extended Dimensions
- Transform Functionality
  - About Transformation Functionality
  - Configuration Files for Transform
- Reprocessing and Retransformation
  - Understanding Reprocessing and Retransformation
  - Preparing for Reprocessing or Retransformation
- Dataset Configuration Tools
- Conditions
- Regular Expressions
- Event Data Record Fields
- Configuration Settings for Web Data
- Time Zone Codes
Report Server
- Understanding Report Sets
- Generating Reports
- Distributing Reports
- Report Set Requirements
- Working with Report Sets
- Report Portal
  - Using the Report Portal
  - Opening the Report Portal
- Advanced Search in the Report Portal
- Installing Report Server
- Administering Report Server
- Installing the Report Portal
- Report Server Parameters Reference
  - Report Server.cfg Parameters
  - Report.cfg Parameters
- Report Sample Files
Page Tagging
- What Kind of Data Can I Acquire?
- How Do I Acquire this Data_
- Implementing Reference Page Tags
- Acquiring Baseline Measurements
- Acquiring Extended Measurements
- Tracking Visitor Activity Within Flash Rich Media Content
- P3P Considerations for Third-Party Page Tagging
- Page Tag Variable Mapping Worksheet
Metrics, dimensions, and filters
- About Data Workbench Metrics, Dimensions, and Filters
- Expanding Metrics, Dimensions, and Filters
- Dimension Types
- Metric Dim Wizard
- Built-in Metrics, Dimensions, and Filters
- Baseline Profiles
Geography
- About Data Workbench Geography
- Installing Data Workbench Geography
- Imagery Layers
- Data Services
- Upgrading and Uninstalling Data Workbench Geography
  - Upgrading Data Workbench Geography
  - Uninstalling Data Workbench Geography
Controlled experiments
- About Data Workbench Controlled Experiments
- How Does Site Identify Visitors?
- How Do Controlled Experiments Work?
- What Should I Test?
- What Are the Requirements?
- Controlled Experimentation
- Creating a Controlled Experiment
- Validating the Experiment
- Viewing the Results
- Experiment Design Spreadsheet
Server Administration and Installation
- Server System Requirements
- Installing Data Workbench Servers
- Administering Data Workbench Server
- Transform
- Insight Server Replication Service
- Repeater
- General Systems Administration
- Upgrading and Uninstalling
- Configuration Settings
- Time Zone Codes
Sensor
- How Does the Data Collection Process Work?
- What are Basic Components
- How Does Sensor Identify Visitors and Sessions?
- Installing
- Administering
- Sensor Txlogd.conf File
- Event Data Record Fields
- Sample Configuration Files
  - Sample Configuration Files
  - Txlogd.conf File Samples
- Sensor Transmitter Command-Line Options
- Sensor UNIX File Permissions
Installing the Monitoring Profile
- Installing the Monitoring Profile
- Workspaces
- Data Workbench Profile Dimensions and Metrics
Dashboard
- Business Opportunities
- Features
- Glossary
- Getting Started
- Dashboard User Interface
- Visualizations
- Dashboards
- Selecting
- Exporting Data
- Dashboard Access Controls
- User Account Management
- Help Menu
Dashboard administrator
- Minimum System Requirements
- Download Required and Optional Components
- Supported Browsers
- Installation Prerequisites
- Server Communication
- Dashboard Deployment
- Managing from the Administration Console
- Profile Connections
- Schema
  - Managing the Schema
  - Initializing and Updating a Profile’s Schema Definition
- Folders
- User Accounts
- User Groups
- System Logs
Implement Data Workbench
- Implementing Adobe Data Workbench
- Data Workbench Discovery and Requirements
- Data Workbench Installation and Provisioning
- Basic Onboarding Instructions for DWB Managed Services
- Data Workbench Architecture
- Schema Design Countable Structures
- Data Workbench Administration
- Configuration and Implementation
- Implementation of Features
Query API
Data Workbench Integration with Adobe Target
Data Workbench Glossary

Related Topics

Related Content

Documentation

Analytics

Data Workbench Help

About the Log Processing Configuration File

Last update: 2022-10-04

Topics:
Data Workbench
View more on this topic

Created for:
User

Admin

IMPORTANT

Read more about Data Workbench’s End-of-life announcement.

The Log Processing.cfg file controls the log processing phase of dataset construction, during which unordered data is read from the data sources (referred to as log sources), and filters and transformations are applied to the data.

You must edit the Log Processing.cfg file to perform any of the following dataset configuration tasks:

Specifying log sources. See Log Sources.
Determining which log entries enter the dataset during log processing. See Data Filters and Log Entry Condition.
Enabling the splitting of tracking IDs with large amounts of event data. See Key Splitting.
Configuring a data workbench server to run as a file server unit. See Configuring an Insight Server File Server Unit.
Configuring a data workbench server to run as a centralized normalization server. See Configuring an Insight Server File Server Unit.

NOTE

Log Processing Dataset Include files can contain additional instructions for the log processing phase of dataset construction. These files exist within the Dataset\Log Processing directory for any inherited profile. They typically define application-specific parameters (such as web-specific configuration parameters for the Site application). For information about Log Processing Dataset Include files, see Dataset Include Files. For information about web-specific configuration parameters for Site, see Configuration Settings for Web Data.