How to ab test your web push notifications in Zoho PageSense | Help guide

A/B test your push message in PageSense

A/B testing your push notification involves comparing two or more different versions of your push message to see which one resonates better with the needs of your website visitors and performs the best in terms of click through rate. In PageSense, you can effortlessly create and test multiple variations of your push notification by changing the title, description, emoji, image, or CTA button color.
For example, you can A/B test your notification by changing only the title while keeping the other attributes the same, or by changing the icon image while keeping the other attributes the same, as shown in the figures below.

Free shipping on Cart!                                 Flat 25% Off on Cart!
Get 25% Off and free shipping on all your cart items today. Hurry up!
Order Now (CTA)

These notifications can then be targeted over your chosen groups of subscribers. The obtained CTR (Click through rate) can then be used to decide which variant works best, so you can continue sending similar notifications in the future.


  1. You need a minimum of 1000 subscribers to A/B test your push notifications in PageSense.
  2. You cannot enable this option for the tests that are already launched.


To run an A/B test for your push notification:

 1. Under the MESSAGE tab, toggle on the Run an A/B Test button at the top-right corner.

2. Under the ORIGINAL tab, add an appropriate title, message, and URL link for your push notification. You can also choose to add an icon, banner image, and button element to your message on the page. Learn how to add and customize your push message in PageSense.

Click the VARIATION 1 tab, then add a new version of the title, message, and URL link of the push notification that you want to A/B test.

You can click on the + icon to create up to five versions of your push message. Click the More icon to do any of the following:
  1. Select Rename to edit the name of the new variation.

  2. Select Duplicate to create a quick copy of a variation, then make minor edits to the new variation.

  3. Select Delete to remove a variation.

While running the A/B test, you can also choose to enable or disable auto-send the most successful variation:
In PageSense, your push notification will be sent automatically to the entire target audience equally amongst all the Variations and Original version. For example, if you have 1000 subscribers, a group of 500 subscribers will receive the Original version and another group of 500 subscribers will receive Variation 1.

However, if you wish to A/B test your message on a smaller percentage of your subscribers, and automatically send the most successful variation to the remaining ones, then you can choose to enable the Auto-send the most successful variation, as shown in the figure.

When this option is enabled, the test is run on 30 percent of your subscribers during the first hour of delivery, and a winning variation is determined under REPORTS. Later, you can send that successful notification to the rest of your user base.

A preview of your push messages will be displayed on the right side of the screen based on different devices and browser types.

5. Click Next (at the top right corner) to choose the target audience segments that you want to send out your notification to.
Your push notification will be randomly sent to your chosen group of subscribers, and a winner will be declared based on the CTR (click through rate) obtained for each variation. 

6. After you launch and obtain your test results under the REPORTS tab, you can send the winning variation of the Web Push Notification to your users.


Additional tip:
Here are a few strategies you can follow before you begin to set up an A/B test for your push notification:

  • Pick one variable (like CTA, title, image, or description) to test at a time. Don't test too many elements together.

  • Segment users based on demographics and buying behaviors to run more targeted and action-driven push messages.

  • Prioritize exactly what you want to test for and once you have a significant result, move on to the next element or test.

  • Attach a specific business goal, like CTA button clicks, time spent on page, etc to your notification to track conversions and measure the impact of your message among users.

    Zoho CRM Training Programs

    Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

    Zoho CRM Training
      Redefine the way you work
      with Zoho Workplace

        Zoho DataPrep Personalized Demo

        If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

        Zoho CRM Training

          Create, share, and deliver

          beautiful slides from anywhere.

          Get Started Now

            Zoho Sign now offers specialized one-on-one training for both administrators and developers.

            BOOK A SESSION

                                You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.

                                    Manage your brands on social media

                                      Zoho Desk Resources

                                      • Desk Community Learning Series

                                      • Digest

                                      • Functions

                                      • Meetups

                                      • Kbase

                                      • Resources

                                      • Glossary

                                      • Desk Marketplace

                                      • MVP Corner

                                      • Word of the Day

                                        Zoho Marketing Automation

                                          Zoho Sheet Resources


                                              Zoho Forms Resources

                                                Secure your business
                                                communication with Zoho Mail

                                                Mail on the move with
                                                Zoho Mail mobile application

                                                  Stay on top of your schedule
                                                  at all times

                                                  Carry your calendar with you
                                                  Anytime, anywhere

                                                        Zoho Sign Resources

                                                          Sign, Paperless!

                                                          Sign and send business documents on the go!

                                                          Get Started Now

                                                                  Zoho TeamInbox Resources

                                                                          Zoho DataPrep Resources

                                                                            Zoho DataPrep Demo

                                                                            Get a personalized demo or POC

                                                                            REGISTER NOW

                                                                              Design. Discuss. Deliver.

                                                                              Create visually engaging stories with Zoho Show.

                                                                              Get Started Now

                                                                                            You are currently viewing the help articles of Sprints 1.0. If you are a user of 2.0, please refer here.

                                                                                            You are currently viewing the help articles of Sprints 2.0. If you are a user of 1.0, please refer here.

                                                                                                  • Related Articles

                                                                                                  • Introduction to push notifications

                                                                                                    Push notifications are clickable pop-up messages that appear on your subscribers' desktop, mobile, or tablet browsers. It's an instant, automated mode of communication between a website and your end user. They typically contain a title, message, ...
                                                                                                  • Quieter notification prompts for web push notifications in PageSense

                                                                                                    With businesses being digitized, sending web push notifications is considered one of the best re-engagement strategies used by marketers to improve customer engagement, reduce churn rates, and maximize conversions on the online store. However, with ...
                                                                                                  • Create and schedule your first push notification

                                                                                                    Grab your audience’s attention even if they are not active on your website. Schedule and send important alerts such as new product releases, last-minute sales, upcoming event reminders, and a lot more to your subscribers to spark conversions on your ...
                                                                                                  • Understand your push notification report

                                                                                                    Track and analyze the impact of your push notification among your subscribers using realtime results. Zoho PageSense allows you to evaluate the success of each notification, with detailed reports based on which notification performed the best, which ...
                                                                                                  • Choose opt-in settings to send web push notifications in PageSense

                                                                                                    The right push notification can have high open rates, but sending too many irrelevant notifications will backfire and make users stop using your application. PageSense provides you the option to create a customized opt-in message that enables ...
                                                                                                    Wherever you are is as good as
                                                                                                    your workplace



                                                                                                      Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.


                                                                                                      Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.


                                                                                                      Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.

                                                                                                      CRM Tips

                                                                                                      Make the most of Zoho CRM with these useful tips.

                                                                                                        Zoho Show Resources