Multivariate A/B Test

How to create a multivariate A/B test in one experience

A/B testing is a powerful tool for data-driven decision-making. Follow these steps to set up a multivariate A/B test within a single experience:

Step 1

Create an experience featuring the widgets you want to test.

Step 2

Once your experience is ready, click on the black "Next" button located on the bottom right side of the screen.

Step 3

On the review page (Section 3), opt to run an A/B test validation by selecting
"Yes Sure." This unlocks the option to create another variation.

Step 4

You can start from scratch or duplicate the current experience and modify the widgets.

Step 5

To view an experience report, go to your experience live dashboard and simply click on the experience whose report you want to see.

In the "Odds to Win" section, you will see which variation performs better compared to the control variation. This parameter will help you decide which variation is best for changing the allocation
to 100%.

Important Info

  • You can create up to six variations within a single experience.
  • Please note that adding more variants might lead to a longer time to reach a clear conclusion.