The Analytics for Target (A4T) panel lets you analyze your Adobe Target activities and experiences in Analysis Workspace. It also enables you to see lift & confidence for up to 3 success metrics. To access the A4T Panel, navigate to a report suite with A4T components enabled. Then, click the panel icon on the far left and drag the Analytics for Target panel into your Analysis Workspace Project.
You can configure the A4T panel using these input settings:
|Target Activity||Select from a list of Target Activities, or drag & drop an activity from the left rail. Note: The list is populated with the last 6 months of activities that had at least 1 hit. If you do not see an activity in the list, it may be older than 6 months. It can still be added from the left rail, which has a look-back period of up to 18 months.|
|Control Experience||Select your control experience. You can change it if necessary in the dropdown.|
|Normalizing metric||Choose from Unique Visitors, Visits, or Activity Impressions. Unique visitors is recommended for most analysis use cases. This metric (also referred to as the counting methodology) becomes the denominator of the lift calculation. It also affects how the data is aggregated before the confidence calculation is applied.|
|Success metrics||Select up to 3 standard (non-calculated) success events from the drop-downs, or drag & drop metrics from the left rail. Each metric will have a dedicated table and visualization in the rendered panel.|
|Calendar date range||This will auto-populate based on the Activity date range from Adobe Target. You can change it if necessary.|
The Analytics for Target panel returns a rich set of data and visualizations to help you better understand how your Adobe Target activity and experiences are performing. At the top of the panel, a summary line is provided to remind you of the panel settings you selected. At any time, you can edit the panel by clicking the edit pencil in the top right.
For each success metric you selected, one freeform table and one conversion rate trend will be shown:
Each freeform table shows the following metric columns:
|Normalizing metrics||Unique Visitors, Visits, or Activity Impressions.|
|Success metric||The metric selected in the builder|
|Conversion rate||Success metric/Normalizing metric|
|Lift||Compares the conversion rate for each experience against the control experience. Note: Lift is a “locked metric” to Target Experiences; it cannot be broken down or used with other dimensions.|
|Lift (Lower)||Represents the worst lift a variant experience could have over the control, at a 95% confidence interval.
Calculation: (x/y ± 1.96 std_err(x,y)) / (x_control/y_control ∓ 1.96 std_err(x_control,y_control)). Here std_err(x,y) is sqrt(xx/y – (x/y)^2), where the xx indicates the sum of squares.
|Lift (Mid)||Represents the midpoint lift a variant experience could have over the control, at a 95% confidence interval. This is “Lift” in Reports & Analytics.
Calculation: (x/y)/(x_control/y_control) – 1
|Lift (Upper)||Represents the best lift a variant experience could have over the control, at a 95% confidence interval.
Calculation: see Lift (Lower).
|Confidence||The students t-test calculates the confidence level, which indicates the likelihood that the results would be duplicated if the test were run again. A fixed conditional formatting range of 75%/85%/95% has been applied to the metric. This formatting can be customized if needed under Column settings. Note: Confidence is a “locked metric” to Target Experiences; it cannot be broken down or used with other dimensions.
Calculation: Apply a 2-tailed t-test with y+y_control-2 degrees of freedom to find the p-value whether x/y equals x_control/y_control. Compute the t-score, where stderr is sqrt( (xx/y-(x/y)^2)/y + (xx_control/y_control-(x_control/y_control)^2)/y_control). Return 1-p as the confidence that they are different.
Like with any panel in Analysis Workspace, you can continue your analysis by adding additional tables and visualizations that will help you analyze your Adobe Target activities. You can also apply a segment either at the panel level or within the freeform table. Note that if you add it within the freeform table, you must overlay it across the entire table to preserve the lift and confidence calculations. Column level segments are not supported at this time.
|What activity types are supported in A4T?||Learn more about what activity types are supported.|
|Are calculated metrics supported in lift and confidence calculations?||No. Learn more about why calculated metrics are unsupported in lift & confidence. Calculated metrics can be used in A4T reporting outside of these metrics, however.|
|Why would unique visitors vary between Target and Analytics?||Learn more about variances of unique visitors between products.|
|When I apply a hit segment for a specific Target activity in my analysis, why do I see unrelated experiences returned?||The A4T dimension is a list variable, which means it can contain many activities (and experiences) at once. Learn more|
|Does the confidence metric account for extreme orders or apply a Bonferroni correction for multiple offers?||No. Learn more about how Analytics calculates confidence.|
|Can lift and confidence metrics be used with other dimensions or breakdowns?||Lift and confidence are “locked metrics” to the Target Experiences dimension because they require a control and variant to calculate across. As such, they cannot be broken down or used with other dimensions.|
|When do lift and confidence re-calculate?||Lift and confidence re-calculate anytime the panel is run (or re-run), the panel date range changes, or a segment is applied to the panel or table. When applying a segment filter to the freeform table, it must be applied across all columns or lift and confidence will not update correctly. Column-level segments are not supported at this time.|
For more information regarding Analytics for Target reporting, visit A4T reporting