Website Optimizer allows you to test a large number of combinations (sections and variations*). The limiting factor is that the more combinations you test, the longer it will take to collect meaningful test results. For high-traffic sites, the difference between testing 10 combinations and 100 may be negligible.
Use this calculator to see how the number of page sections and variations you test affects the length of your experiment.
As shown in the calculator, there are five factors which influence how long an experiment will take:
- Number of Combinations (more combinations => longer duration)
- Conversion Rate (higher conversion => shorter duration)
- Web Site Traffic (higher traffic => shorter duration)
- Estimated Conversion Rate Lift (greater improvement => shorter duration)
- Percentage of participation (lower participation=> longer duration)
The factor over which you have the most control is the number of combinations.
The maximum number of page sections and variations you can test are:
Maximum page sections: 8
Maximum variations per section: 127 (in addition to the original content)
Maximum combinations = 10,000
Please note that the maximum number of combinations limits the actual number of page sections and variations you can use (127 to the 8th power far exceeds 10,000), while still allowing for lots of flexibility. For example, you could designate three page sections, one with 127 variations and two with 2 variations (127 x 2 x 2 = 508). Alternatively, you could create an experiment with 8 sections, one with 7 variations and the rest with 2 variations (7 x 2 x 2 x 2 x 2 x 2 x 2 x 2 = 896).
* The number of combinations is calculated by multiplying the number of variations for each section: 4 headlines, 3 images and 5 pieces of text is 4 x 3 x 5 = 60 combinations.
