Best Practices

  • Don’t include more locations than necessary for the test. Every experience you include in the test significantly increases the amount of traffic and time required to achieve acceptable results. For example, if you have page elements with three offers each, there are nine possible combinations (3x3). Three elements, where two contain three possible offers and one has two offers, provide 18 options (3x3x2). The numbers increase substantially with each additional element and offer.
  • When creating multivariate tests, you can exclude more than 10 percent of experiences from the test, provided you acknowledge the warning that you must then use offline reporting for analysis.
  • Take advantage of the preview features to avoid undesirable combinations of content. For example, you might have two images that offer different discounts on the same item or service. Showing both of these images on the same page is illogical and is likely to create confusion.
  • Use the Traffic Estimator to make sure that your test is designed for the amount of traffic your page receives. Make sure that the Traffic Estimator gives your test configuration the green light so you can get the results you desire.
  • You must have at least three elements to test. If you have fewer, run a series of A/B tests.
  • Each element’s alternatives should be significantly different from each other.
  • Although not required, it is good practice for each element to have the same number of alternatives.

Target


Adobe Target Maturity Webinar Series

Adobe Customer Success Webinars

Tuesday, Feb 4, 4:00 PM UTC

Adobe Target innovations, including GenAI, and best practices on AI-powered personalization and experimentation at scale.

Register