Model Insights

To view model insights, in the Models Models interface in Mix Modeler:

  1. From the Models table, select the name of a model that has a Last run status of ● Success.

  2. From the context menu, select Model Insights.

Model insights tab bar

You see when the specified model is last refreshed and visualizations are displayed using four tabs: Model insights, Attribution, Factors, Diagnostics, and Historical overview.

You can change the date period on which the visualizations on each of the tabs are based on. Enter a date period or select Calendar to select a date period.

Model insights

The Model insights tab shows visualizations for Contribution by date and base media, Contribution by channel, Marketing performance summary, and Marginal response curves. The tab also provides a Touchpoint breakdown table.

Model - Model insights

  • You can hover over individual chart elements in each visualization to display a popover with more details.

  • To download a CSV file containing the data for the visualization, select Download .

  • To download full model insights data in Microsoft® Excel format, select Download Download data.

Contribution by date and base media.

The stacked graph is ordered: Base at the bottom, Non-spend channels in the middle, and Spend channels on top.

Contribution by channel

The donut visualization shows a distribution of the contribution by channel.

Marketing performance summary.

A horizontal bar graph displaying the ROI performance by channel.

Marginal response curves.

The line chart visualizes and compares the marginal returns generated by the investment in your marketing channels. And identifies the break-even point where your incremental return is less than your incremental spend. As a result, this visualization helps you to understand when your marketing investment starts to become less impactful.

The curve, break-even point, and corresponding values are calculated based on the selected data range and the channel you have selected.

To change the channel:

  • Select a channel from the Channel dropdown menu to update the visualization for a specific channel.

Attribution

NOTE
The Attribution tab is only available for MTA enabled models.

Using the Attribution tab, you can understand the effectiveness of touchpoints and marketing campaigns that have event level data. See Create a model.

The following attribution models are supported:

  • Based on the selected model in Mix Modeler:

    • Algorithmic - Influenced
    • Algorithmic - Incremental
  • Rule based:

    • Decay units
    • First touch
    • Last touch
    • Linear
    • Ushape

See Multi-touch attribution for an introduction on the multi-touch attribution capability in Mix Modeler.

Select one or more attribution models from the Attribution Model dropdown menu. The selected attribution models apply to all visualizations in the Attribution tab.

Attribution

The Mix Modeler multi-touch attribution granular event scores align to the overall Mix Modeler scores and ROIs. These scores are also made available as datasets in Experience Platform.

The Attribution tab consists of the following visualizations:

Overview

The Overview visualization shows, for the selected attribution models, the conversions totals and percentages. Selecting more models adds additional circles to the visualization, each with its own color corresponding to the legend.

To see a popup with details for an attribution model, hover over any of the circles in the visualization.

The Daily trends, Weekly trends, or Monthly trends visualization shows, for the selected attribution models, the daily, weekly, or monthly conversion trends.

To choose the period, select Daily trends, Weekly trends or Monthly trends from More .

To see details, hover over the data line of a specific attribution model to display a popover that shows the total number of conversions for that data.

Breakdown

The Breakdown visualization is a breakdown by channel or touchpoint of the conversions for each of the selected attribution models. This visualization can be helpful to make decisions on the effectiveness of each channel or touchpoint.

To choose the breakdown type, select Breakdown by channel or Breakdown by touchpoint from More .

To see details, hover over any of the chart elements.

Top campaigns

The Top campaigns visualization shows a table of the top campaigns with columns for Campaign name, Channel, Media type and Incremental conversions. This visualization can help inform your team of the effectiveness of a specific campaign for a given channel and provide insights on what campaigns you should further invest into.

To sort the table in ascending ↑ or descending order ↓ for Channel, Media type or Incremental conversions, select the column header and toggle the sort.

To expand the table in a separate dialog, select Expand from More .

The expanded Top campaigns dialog shows the same table with addition columns for

  • Incremental conversions

  • Influenced conversions

  • First touch conversions

  • Last touch conversions

    You can select each of the additional column headers to sort the table in ascending or descending order.

To close the expanded Top campaigns dialog, select Close.

Breakdown by touchpoint position

The Breakdown by touchpoint position visualization is a breakdown of attributed conversions by position of the touchpoint and touchpoint across all the conversion paths. This chart helps you to compare if a touchpoint contributes better at a position than remaining positions and other touchpoints at any position.

NOTE
The sum of percentage contribution for an attribution model across all touchpoints and positions should be equal to 100.

The positions Starter, Player and Closer are defined as follows:

Position
Description
Starter
This position indicates whether the touchpoint is the first touch in a conversion path.
Player
This position indicates whether the touchpoint is not the first or the last touch leading to conversion.
Closer
This position indicates whether the touchpoint is the last touch before conversion.

Top conversion paths

The Top conversion paths visualization shows the top 5 conversion paths based on the selected attribution models.

For each conversion path, you see:

  • the number of channels that do have an impact,
  • the total attributed paths,
  • the percentage of attributed paths for this conversion path vs. total attributed paths,
  • for each channel, the attribution model contribution percentage, and
  • the sum of these channel attribution model contribution percentages.

Factors

The Factors tab shows external factor related insights.

Factors

This visualization helps you to understand the incremental effect that various internal and external factors have on the baseline of conversions. For example, economic conditions or promotional activities.

To download a CSV file containing the data for the table, select Download .

If no data is available you see a message TableAndChart No data is available, you may need to retrain your model, or change the date range to view insights.

Diagnostics

The Diagnostics tab shows visualizations for:

  • Model Assessment visualization, which you can break down on Actual vs. Predicted or Residual conversions.

    To break down the visualization, select Actual vs. Predicted or Residuals from the Breakdown list.

  • Model fitting metrics table, showing the following columns for each conversion metric:

    • Actual Conversion

    • Modeled Conversion

    • Residual Conversion (difference between actual and modeled conversion)

    • Model quality score values:

      • R2 (R-squared), which tells how well the data fits the regression model (the goodness of fit).

      • MAPE (Mean Absolute Percentage Error), which is one of the most commonly used KPIs to measure forecast accuracy and expresses the forecast error as a percentage of the actual value.

      • RMSE (Root Mean Square Error): which shows the average error, weighted according to the square of the error.

    To download a CSV file containing the data for the table, select Download .

  • Touchpoint effectiveness table, representing the outcome of the Attribution AI algorithmic model. The data for this table is only generated for specific periods of time. Select As of xx/xx/xx, xx:xx TZ Info for more details.

    The visualization shows, in descending order of Efficiency measure Descending Order , for each touchpoint:

    • Paths touched: visualizes the percentage of paths achieving conversion and percentage of paths not achieving conversion. For a touchpoint, you see more attributed conversions when the attribution conversion ratio is high. This ratio compares the percentage of paths that lead to conversion versus the percentage of paths that do not lead to conversion.
    • Efficiency measure: generated by the algorithmic attribution model, the efficiency measure indicates the relative importance of a touchpoint toward conversion, independent of touchpoint volume. The efficiency is measured on a scale of 1 to 5. Note that higher touchpoint volume does not guarantee higher efficiency measure.
    • Total volume: The aggregate number of times a user touches a touchpoint. The number is inclusive of touchpoints that appear on a path achieving conversion as well as paths not resulting in conversion.

Diagnostics

Historical overview

The Historical overview tab shows visualizations for:

  • Conversion and Spend by Fiscal Qtr and Product.

  • Spend by Channel.

  • Touchpoint Spend.

    You can select an alternative spend-based channel to display for this visualization. Select a channel from Channels.

  • Touchpoint Volume.

    You can select an alternative volume-based channel to display for this visualization. Select a channel from Channels.

Model - Historical overview

recommendation-more-help
d5f9b631-c793-4214-8dc7-f78d1750e4f4