Dataset rules

Dataset rules assist you in mapping your harmonized fields with fields from the data you ingested in Mix Modeler.

  • For aggregate data that you ingested in Adobe Experience Platform, you map one or more of the available dataset fields to the appropriate harmonized fields.
  • For event data, you can individually map one or more harmonized fields to fields from the dataset, directly or using conditions.

Manage dataset rules

To see a table of the available dataset rules, in the Mix Modeler interface:

  1. Select DataSearch Harmonized data from the left rail.

  2. Select Dataset rules from the top bar. You see a table of the dataset rules.

The table columns specify details about the dataset rules:

Column name
Details
Dataset
The name of the dataset.
Source
The source of the dataset: Adobe Analytics, Experience Events, Summary (aggregate), or Consumer Experience Events.
Schema
The schema to which the dataset conforms. You can quickly select the schema name to open the schema in a new tab in the schema editor in Schema Schemas.
Granularity
The granularity of data in the dataset. Possible values are Daily, Weekly, Monthly or Yearly.
Start of the week
Specifies which day of the week is considered the start of a new week for the specific dataset.
Status

The status of the field:

● Draft or

● Active

Last modified
Data and time of the last modification of the dataset rule.

Create a dataset rule

To create a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler, select Create a dataset rule in the Dataset rules configuration wizard.

In the Create screen,

  1. In Dataset details, select a dataset from Select dataset to begin configuration. In the list, datasets are categorized in Consumer Experience Events, Adobe Analytics, Experience Event and, Summary.

  2. Select a day for the Start of the week.

  3. Select Daily, Weekly, Monthly or Yearly for Granularity.

  4. When you have selected a dataset of the Summary category:

    1. To define whether data for the dataset aggregates or replaces existing data, select Aggregation or Replacement for Data restatement is by.

    2. Map each of the Available dataset fields to corresponding Standard harmonized fields in Map to harmonized fields. If you do not want to map a dataset field to a harmonized field, explicitly select – None –.

    3. If you need a new harmonized field, not available from the list, select Create New to create a new harmonized field. You see the dialog as outlined in Add a new harmonized field.

    4. When the mapping is completed for all fields for the rule, select Save as draft to save a draft version of the rule or Save to save and activate the rule. Select Cancel to cancel the rule configuration.

      Create dataset rules

  5. When you have selected an event category dataset (Experience Events, Adobe Analytics, Consumer Experience Events), in the box underneath Map to harmonized fields:

    1. Select a harmonized field from Standard harmonized field.

    2. When the selected harmonized field is of type metric:

      1. Select Count or Sum from Mapping type.

      2. Select an AEP dataset field that you want the harmonized field to map to by default.

    3. When the selected field is of type dimension:

      1. Select Map Into or Case from Mapping type.

      2. When you have selected Map Into, select Field and AEP dataset field or Value and a default value to map the harmonized field by default to the dataset field or entered value.

      3. When you select Case, select Field and AEP dataset field or Value and a default value to map the harmonized field by default to the dataset field or entered value.

        1. To set values explicitly, you define one or more cases, consisting of one or more conditions. Each condition can check for a specific AEP dataset field whether it Exists or Not Exists or whether it Contains, Not Contains, Equals, Not Equals, Starts With, or Ends With a value entered at Enter input value.

        2. To add another case, select Add Add case, to add another condition, select Add Add condition.

        3. To delete a case or condition, select Close in the corresponding container.

        4. To select whether any or all of the conditions should apply for a case, select Any of or All of.

        5. To set the outcome value for a case, enter the value at Then.

      The example below

      • uses a Map Into Mapping type to map the Channel Type At Source harmonized field to the channel_type field from the Luma Transactions dataset.

      • uses a Case Mapping type to conditionally map the value of the marketing.campaignName field in the Luma Transactions dataset to the Campaign harmonized field. The Campaign harmonized field is set to:

        • Black Friday when the marketing.campaignName is _black_friday or BlackFriday.
        • to the value of the marketing.campaignName in all other cases.

        Dataset rule event

  6. Select Add Add field to define additional fields.

When finished, select Save as draft to save a draft version of the rule or Save to save and activate the rule. Select Cancel to cancel the rule configuration.

Edit a dataset rule

To edit a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler:

  1. Select More in the Dataset column for the dataset rule that you want to edit.
  2. From the context menu, select Edit Edit to start editing the dataset rule. Refer to Create a dataset rule for more details.

Delete a dataset rule

To delete a dataset rule, in the DataSearch Harmonized data > Dataset rules interface in Mix Modeler:

  1. Select More in the Dataset column for the dataset rule that you want to delete.
  2. From the context menu, select Delete Delete to delete the dataset rule. You are prompted for confirmation. Select Delete to delete the selected dataset rule permanently.

Sync data

To sync data between your harmonized data and summary and / or event datasets, following all of the logic in your dataset rules:

  1. Select Sync data.

  2. From the Sync data for dataset rules dialog, either select

    • Refresh harmonized data for summary datasets,
    • Refresh harmonized data for event datasets, or
    • Refresh harmonized data for both summary + event datasets.
  3. To start the synchronization based on the defined dataset rules between harmonized data and data in datasets, select Sync. To cancel the synchronization, select Cancel.

    Sync data

Data merge preferences

NOTE
[beta]{class="badge informative"} The Data merge preferences is a beta feature and its functionality is subject to change.

Data merge preferences assists in resolving conflicts when data from summarized and event data sources are merged. Use cases are:

  • the same advertising metric is measured and reported in multiple datasets, or
  • metrics measurement may be incomplete in some datasets, while another dataset may be a superset of a particular metric, resulting to double counting.

To ensure accurate model predictions, you can define data merge preferences:

  1. Select Data merge preferences [beta]{class="badge informative"}.

  2. In the Data merge preferences [beta]{class="badge informative"} dialog:

    Data merge preferences

    • Select a Default metric preference. The selected default metric preference is applied when, during harmonization, multiple sources of data update a metric field for a given channel. The preference is applied at the sandbox level, unless overridden for specific metric based preferences. You can select between Summary data, Event data and Sum of summmary and event data.

    • To add specific metric based preferences:

      1. Select Plus Add a metric.

        1. Select a metric from the Metric selection list.
        2. Select CHANNELS or CONVERSION TYPES. From the list, select All or a specific channel or conversion type.
        3. Select Summary or Event to specify whether summary data or event data is preferred for the metric (and all or selected channel) when merging data.

        To add one or more additional channel or conversion types:

        1. Select Plus Add a channel or Plus Add a conversion type.
        2. Select Summary or Event.

        To delete a channel or conversion type, select Cross .

      2. To add more specific metric based preferences, repeat the previous step.

    • To delete an existing specific metric based preference, select Delete .

  3. Select Save to save the data merge preferences. A re-sync of the data is initiated.
    Select Cancel to cancel.

Field-level access control

When configuring dataset rules for harmonized datasets, Experience Platform’s attribute based access control is enforced on a field-level. A field is restricted when a label is attached to a schema field and an active policy is enabled that denies access for you to that field. As a result:

  • you do not see the schema fields that are restricted for you when you create a dataset rule,
  • you are not able to view or edit the mapping of one or more schema fields that are restricted for you. When you edit or view a dataset rule containing such restricted fields, you see the following screen.
    Action not permitted
recommendation-more-help
d5f9b631-c793-4214-8dc7-f78d1750e4f4