How to ab test your web push notifications in Zoho PageSense | Help guide

A/B test your push message in PageSense


A/B testing your push notification involves comparing two or more different versions of your push message to see which one resonates better with the needs of your website visitors and performs the best in terms of click through rate. In PageSense, you can effortlessly create and test multiple variations of your push notification by changing the title, description, emoji, image, or CTA button color.
For example, you can A/B test your notification by changing only the title while keeping the other attributes the same, or by changing the icon image while keeping the other attributes the same, as shown in the figures below.

Free shipping on Cart!                                 Flat 25% Off on Cart!
Get 25% Off and free shipping on all your cart items today. Hurry up!
Order Now (CTA)


These notifications can then be targeted over your chosen groups of subscribers. The obtained CTR (Click through rate) can then be used to decide which variant works best, so you can continue sending similar notifications in the future.

Important:

  1. You need a minimum of 1000 subscribers to A/B test your push notifications in PageSense.
  2. You cannot enable this option for the tests that are already launched.

 

To run an A/B test for your push notification:

 1. Under the MESSAGE tab, toggle on the Run an A/B Test button at the top-right corner.




2. Under the ORIGINAL tab, add an appropriate title, message, and URL link for your push notification. You can also choose to add an icon, banner image, and button element to your message on the page. Learn how to add and customize your push message in PageSense.



3.
 
Click the VARIATION 1 tab, then add a new version of the title, message, and URL link of the push notification that you want to A/B test.



4.
 
You can click on the + icon to create up to five versions of your push message. Click the More icon to do any of the following:
  1. Select Rename to edit the name of the new variation.

  2. Select Duplicate to create a quick copy of a variation, then make minor edits to the new variation.

  3. Select Delete to remove a variation.

While running the A/B test, you can also choose to enable or disable auto-send the most successful variation:
In PageSense, your push notification will be sent automatically to the entire target audience equally amongst all the Variations and Original version. For example, if you have 1000 subscribers, a group of 500 subscribers will receive the Original version and another group of 500 subscribers will receive Variation 1.

However, if you wish to A/B test your message on a smaller percentage of your subscribers, and automatically send the most successful variation to the remaining ones, then you can choose to enable the Auto-send the most successful variation, as shown in the figure.

When this option is enabled, the test is run on 30 percent of your subscribers during the first hour of delivery, and a winning variation is determined under REPORTS. Later, you can send that successful notification to the rest of your user base.

A preview of your push messages will be displayed on the right side of the screen based on different devices and browser types.

5. Click Next (at the top right corner) to choose the target audience segments that you want to send out your notification to.
Your push notification will be randomly sent to your chosen group of subscribers, and a winner will be declared based on the CTR (click through rate) obtained for each variation. 

6. After you launch and obtain your test results under the REPORTS tab, you can send the winning variation of the Web Push Notification to your users.

 

Additional tip:
Here are a few strategies you can follow before you begin to set up an A/B test for your push notification:

  • Pick one variable (like CTA, title, image, or description) to test at a time. Don't test too many elements together.

  • Segment users based on demographics and buying behaviors to run more targeted and action-driven push messages.

  • Prioritize exactly what you want to test for and once you have a significant result, move on to the next element or test.

  • Attach a specific business goal, like CTA button clicks, time spent on page, etc to your notification to track conversions and measure the impact of your message among users.


    Access your files securely from anywhere

      Zoho CRM Training Programs

      Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

      Zoho CRM Training
        Redefine the way you work
        with Zoho Workplace

          Zoho DataPrep Personalized Demo

          If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

          Zoho CRM Training

            Create, share, and deliver

            beautiful slides from anywhere.

            Get Started Now


              Zoho Sign now offers specialized one-on-one training for both administrators and developers.

              BOOK A SESSION





                          Quick Links Workflow Automation Data Collection
                          Web Forms Enterprise Begin Data Collection
                          Interactive Forms Workplace Data Collection App
                          CRM Forms Customer Service Accessible Forms
                          Digital Forms Marketing Forms for Small Business
                          HTML Forms Education Forms for Enterprise
                          Contact Forms E-commerce Forms for any business
                          Lead Generation Forms Healthcare Forms for Startups
                          Wordpress Forms Customer onboarding Order Forms for Small Business
                          No Code Forms Construction RSVP tool for holidays
                          Free Forms Travel
                          Prefill Forms Non-Profit

                          Intake Forms Legal
                          Mobile App
                          Form Designer HR
                          Mobile Forms
                          Card Forms Food Offline Forms
                          Assign Forms Photography
                          Mobile Forms Features
                          Translate Forms Real Estate Kiosk in Mobile Forms
                          Electronic Forms

                          Notification Emails for Forms Alternatives Security & Compliance
                          Holiday Forms Google Forms alternative  GDPR
                          Form to PDF Jotform alternative HIPAA Forms
                          Email Forms
                          Encrypted Forms
                          Embeddable Forms
                          Secure Forms
                          Drag and Drop form builder
                          WCAG


                                            You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                Manage your brands on social media

                                                  Zoho Desk Resources

                                                  • Desk Community Learning Series


                                                  • Digest


                                                  • Functions


                                                  • Meetups


                                                  • Kbase


                                                  • Resources


                                                  • Glossary


                                                  • Desk Marketplace


                                                  • MVP Corner


                                                  • Word of the Day


                                                    Zoho Marketing Automation

                                                      Zoho Sheet Resources

                                                       

                                                          Zoho Forms Resources


                                                            Secure your business
                                                            communication with Zoho Mail


                                                            Mail on the move with
                                                            Zoho Mail mobile application

                                                              Stay on top of your schedule
                                                              at all times


                                                              Carry your calendar with you
                                                              Anytime, anywhere




                                                                    Zoho Sign Resources

                                                                      Sign, Paperless!

                                                                      Sign and send business documents on the go!

                                                                      Get Started Now




                                                                              Zoho TeamInbox Resources



                                                                                      Zoho DataPrep Resources



                                                                                        Zoho DataPrep Demo

                                                                                        Get a personalized demo or POC

                                                                                        REGISTER NOW


                                                                                          Design. Discuss. Deliver.

                                                                                          Create visually engaging stories with Zoho Show.

                                                                                          Get Started Now









                                                                                                              • Related Articles

                                                                                                              • Introduction to push notifications

                                                                                                                Push notifications are clickable pop-up messages that appear on your subscribers' desktop, mobile, or tablet browsers. It's an instant, automated mode of communication between a website and your end user. They typically contain a title, message, ...
                                                                                                              • Quieter notification prompts for web push notifications in PageSense

                                                                                                                With businesses being digitized, sending web push notifications is considered one of the best re-engagement strategies used by marketers to improve customer engagement, reduce churn rates, and maximize conversions on the online store. However, with ...
                                                                                                              • Create and schedule your first push notification

                                                                                                                Grab your audience’s attention even if they are not active on your website. Schedule and send important alerts such as new product releases, last-minute sales, upcoming event reminders, and a lot more to your subscribers to spark conversions on your ...
                                                                                                              • Understand your push notification report

                                                                                                                Track and analyze the impact of your push notification among your subscribers using realtime results. Zoho PageSense allows you to evaluate the success of each notification, with detailed reports based on which notification performed the best, which ...
                                                                                                              • Choose opt-in settings to send web push notifications in PageSense

                                                                                                                The right push notification can have high open rates, but sending too many irrelevant notifications will backfire and make users stop using your application. PageSense provides you the option to create a customized opt-in message that enables ...
                                                                                                                Wherever you are is as good as
                                                                                                                your workplace

                                                                                                                  Resources

                                                                                                                  Videos

                                                                                                                  Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                  eBooks

                                                                                                                  Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                  Webinars

                                                                                                                  Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                  CRM Tips

                                                                                                                  Make the most of Zoho CRM with these useful tips.



                                                                                                                    Zoho Show Resources