Auto Allocate Activities: Lift and confidence not shown for Secondary metrics

Description description

When changing the report metrics, the lift and confidence values remain unchanged in Target activity reports. Why?

Target

Issue/Symptoms

  • No lift bounds are displayed for Auto Allocate activities until one experience has attained 60% confidence.
  • Lift and confidence are not updated for secondary metrics for Auto Allocate activities.

When changing the report metrics, the lift and confidence values remain unchanged in Target activity reports. Why?

Resolution resolution

Auto-allocation consumes only the primary goal metric to train the underlying AA model and determine the winning experience as the test matures. Other/additional metrics do not play any role there, unlike manual AB tests, where one can compare experiences based on any given metric and push the winner manually in the end. Providing lift, confidence, etc., for non-primary goal metrics will not be right in this case. So, if you want to compute the statistics and compare the experiences based on an additional metric, this is to be done manually.

recommendation-more-help
3d58f420-19b5-47a0-a122-5c9dab55ec7f