AB testing - Online Help | Zoho Campaigns

AB testing

 

What is the maximum percentage for testing an A/B testing campaign?  

The maximum limit is 60%. This ensures a balance between obtaining accurate A/B test results and delivering the winning content effectively to the rest of your list.

Notes

Note

It is not possible to select the recipients based on the number of contacts

.

Do you have A/B testing campaigns in Automation?  

Yes, we have A/B testing campaigns in Workflows. However, we cannot send customized responses for the A version and B version separately.

 

How are the winners selected in A/B testing campaigns set up?  

The winning version can be selected based on the open rate or click rate. Alternatively, you can also select the winner manually.

What are all the parameters available for testing in an A/B campaign?  

Zoho Campaigns allows A/B testing with the following parameters: subject, sender details, and email content.

What is the difference between a regular email campaign and an A/B test campaign?  

A regular email campaign is a single version of email that you send to your contacts. But in an A/B test campaign, you'll create two versions of the same campaign that will be sent to two different groups of contacts. The difference will be in either the subject, sender details, or email content of the campaign. Once both sets of emails are sent out, their performance will be decided based on either the open rate, click rate, or manually.

 

Learn more about creating A/B test email campaigns in Zoho Campaigns

 

I want to send a chain campaign to all unopened contacts of an A/B Campaign. How do I create one?  

 It is not possible to create chain campaigns for an A/B Campaign. However, you can export the unopened contacts, import them to a new mailing list, and send the campaign to the unopened contacts.

To export unopened contacts:

  1. From the navigation toolbar, choose Reports and select Sent Campaigns.

  2. Select the A/B campaign and switch to the Recipient Activity tab.

  3. Select Unopened and click Export.

  4. Fill in the essential fields and click Export.

If both A & B score equally - who will be the winner?  

If both A & B score equally, we will extend the test time by half an hour and recheck the results. If the result remains the same, then it is a 'Tie'. In this case, the test remains inconclusive. We will send you an email and you will have to choose between one of the options.

How do I clone my A/B test campaign?  

You can clone your A/B test campaign by following these steps:

 

  1. From the navigation toolbar, choose Campaigns and Email Campaigns.
    Email campaigns

  2. Mouse over the A/B campaign you want to clone and click the Clone icon.
    Clone

  3. Enter the relevant details and click Save.
    Enter details