Introduction to Multivariate Testing

Introduction to Multivariate Testing

Overview  

Multivariate Testing in Zoho PageSense helps you evaluate how multiple elements on a webpage influence a single conversion goal. Instead of testing one change at a time, multivariate testing lets you modify several elements and analyze how different combinations of those changes affect visitor behavior.
By testing these combinations simultaneously, you can identify the most effective arrangement of page elements that improves conversions such as clicks, sign-ups, purchases, or form submissions.
 

What is Multivariate Testing?  

Multivariate testing evaluates different combinations of changes made to multiple elements on the same page.
Each element you modify creates variations, and PageSense automatically generates combinations of those variations to determine which version performs best for your goal.
For example, you can test:
  • Headline text
  • CTA button color
  • CTA button text
  • Banner images
PageSense then analyzes which combination of these changes produces the highest conversion rate.
 

Why Use Multivariate Testing?  

Multivariate testing helps you understand how different elements work together on a webpage.
Instead of running multiple experiments one after another, you can test several elements in a single experiment and discover which combination performs best.
Benefits include:
  • Test multiple page elements at once
  • Identify the most effective element combination
  • Reduce the time required for sequential testing
  • Gain deeper insights into user behaviour 

How Multivariate Testing Works  

Multivariate experiments are organized using Sections, Variations, and Combinations. Understanding these three components helps you build and manage your experiment effectively.
 

Sections and Variations  

Sections  

A section represents a specific element on the page that you want to test.
For example:
  • Section 1 → Menu bar color
  • Section 2 → Header text
  • Section 3 → CTA button text
Each section focuses on one element of the page.
A new section is automatically created when you modify a new element in the editor.
 

Variations  

A variation is a modified version of an element inside a section.
For example:
Section: CTA Button Color
  • Control → Green button
  • Variation 1 → Blue button
  • Variation 2 → Red button
You can create additional variations for an element by clicking the + icon in the section.
Each variation represents a different version of that element.
 
Important Notes  
  • Each variation contains one modification to the element.
  • If you edit the same element again, the variation will remain in the same section.
  • If you edit a different element, PageSense creates a new section automatically.
 

How Combinations Are Created  

Once you create variations across multiple sections, PageSense automatically generates combinations of all variations.
Each combination represents a unique version of the webpage.
Example:
Section 1 – Menu Color  
  • Control (Green)
  • Variation A (Red)
  • Variation B (Blue)
Section 2 – Button Text  
  • Control (Try Now)
  • Variation X (Buy Now)
  • Variation Y (Get Started)
Total combinations:
3 variations × 3 variations = 9 combinations
Each combination is tested to determine which performs best.

Example combinations:

Combination
Menu Color
Button Text
C1
Control
Control
C2
Control
Buy Now
C3
Control
Get Started
C4
Red
Control
C5
Red
Buy Now
C6
Red
Get Started
C7
Blue
Control
C8
Blue
Buy Now
C9
Blue
Get Started

PageSense automatically generates these combinations when variations are added.



We’ve designed this documentation to guide you every step of the way. If you need further assistance or have any questions, don’t hesitate to contact us at support@zohopagesense.com - we’re always here to help!