Audience Lab Use Cases audience-lab-use-cases
Audience Lab enables several use cases by allowing you to use baseline segments for creating test groups. You can divide test groups into several mutually exclusive test segments, map these to different destinations and then determine which of the segments are most effective in driving conversions.
Compare Models in Audience Lab compare-models
You can use several different types and sources of models in Audience Manager. Audience Lab offers an easy way to compare your customers’ conversion rates, across your active models.
In this use case, you are comparing different models. You can either use models created via an in-house data warehouse and import them in Audience Manager as Onboarded Traits or you can use the Algorithmic Models feature in Audience Manager.
-
Create two models, either in the Model Builder, or via an outside platform.
-
Create algorithmic traits from the algorithmic model or import your own models as onboarded traits.
-
Create mutually exclusive segments so users in both models don’t overlap:
- Create a Model 1 Segment and a Model 2 Segment.
- Have the segment rule for Model 1 Segment be model 1 trait AND NOT model 2 trait, and vice-versa for Model 2 Segment.
-
Create two segment test groups in Audience Lab, one with Model 1 Segment as the baseline, the other with Model 2 Segment as the baseline.
- Keep the variables the same for both test groups: same destinations, creative, conversion traits.
- Make sure the test segments have similar numbers of users (e.g. 1.6 million and 1.8 million is alright, 1.6 million and 16 million is not).
- Reserve a control segment in each test segment test group. This way, you can set aside a small part of each segment and not target them explicitly in the test.
-
Examine the results:
- The Audience Lab reporting view will show the number of conversions each model is driving. For conversion based campaigns, the test segment that drives the most conversions will signify the model that is performing best.
- Because you have control segments, you can also evaluate how the model did against “standard targeting.” You are not only just testing one model versus the other, but testing the question of “did this model do better than normal practices?”
Testing Creatives Across Destinations testing-creatives
Use Audience Lab to measure the number of conversions a creative is driving across different destinations. This use case also allows you to measure the conversions of the creative against naturally occurring conversions.
- Create a Segment Test Group, selecting the segment you want to test the creative against as the baseline segment.
- Split the baseline segment into test segments and control segments.
- Map the test segments to the different destinations you wish to test.
- The control segment can be withheld and not mapped to any destination. The control segment should not be targeted by the test creative to set a results baseline for naturally occurring conversions.
- Specify a start date and an end date for the test.
- Set up the segment and the creative in the destinations.
- The Audience Lab reporting view will show the number of conversions the creative is driving across the destinations.
- Because you created a control segment, you can also evaluate how the creative did against naturally occurring conversions. You are testing the question: “Did this creative generate a higher conversion rate than normal practices?”