Auto Allocate Activities : Lift and confidence not shown for Secondary metrics


When changing the report metrics, the lift and confidence values remain unchanged in Target activity reports. Why?


  • For Auto-Allocate activities, no lift bounds are displayed until one experience has attained 60% confidence.
  • Lift and confidence are not updated for secondary metrics for an Auto Allocate activities

Explanation :

Auto-allocation consumes only primary goal metric to train the underlying AA model and determine the winning experience as the test matures. Other / additional metrics do not play any role there unlike manual AB-tests where one can compare experiences based on any given metric and push the winner manually in the end.  Providing lift, confidence etc. for non-primary goal metric will not be right in this case. So, if the you want to compute the statistics and compare the experiences based on an additional metric, this is to be done manually.

On this page