CRO hack #09: Beyond Inconclusive A/B Tests

CRO hack #09: Beyond Inconclusive A/B Tests



Despite having a hypothesis that checks all right boxes, there is still a high chance that your A/B test returns inconclusive results. However, this isn't a dead-end. In fact, there's still significant insight you can gather from this report. Here are a couple ideas to get you started:

Analyze micro conversions:
Say the primary goal of the test gets the highest conversions in a particular variation. If these numbers are statistically significant, then this variation is declared the winner, else the result is inconclusive. Now, instead of just looking into the primary goal's conversions, analyze the conversions of the secondary goals that you've set. You might find a significant jump in these micro conversions.

For example, visitors to the variation with the revamped content spend a lot more time on it. Or, a particular case study is shared more because of a new infographic. In both of these cases, your primary goal might have been a form submission. But these kinds of engagements can help your brand in the long run.

You can, however, use this new information to tweak the page further and run new A/B test on it—perhaps actively shaping the variation in a way that intuitively nudges the visitor towards the primary goal with minimal distractions.

Rework what defines a variation:
Just because one version of your hypothesis doesn't get substantial results doesn't mean you need to scrap the entire idea, just shift your perception of the hypothesis. 

Say you run a poll on your homepage and find out that visitors aren't signing up because they are unsure of your brand. So, to build brand trust, you create a variation of the page which has a section of trust icons. However, this test turns out to be inconclusive. 

Instead of discarding this hypothesis, think of a new approach to build your brand's trust: adding testimonials, links to case studies, or adding a section of certified ratings.


Slice and dice the test report:
It is crucial that you breakdown the behavior of specific audience segments after running a test. You might find that a particular segment if your audience is responding better to the changes you've made. 

For instance, many returning visitors convert if they are shown a product use-case video. Or, visitors from social media convert more if they land on the home page instead of the product page.

Next, you can personalize this change only for this audience type to maximize conversions.

In short:




Cheers, 
Tanya

    Zoho Marketing Automation
            • Sticky Posts

            • A/B Testing Idea #1: Place irresistible and clear CTA buttons

              Are you wasting much of your time and effort A/B testing every single idea that pops into your head, yet you're not generating sufficient traffic to your website? Don't worry—we've got you.   We'd like to introduce you to the A/B Testing Ideas learning
            • CRO hack #04: Hacking a cold heatmap

              Heatmaps do the talking for themselves. They show you where the visitors are clicking—helping you understand exactly which sections on your website are the most engaging. The heatmap of a well-designed landing page will show you exactly what the page's aim is: Get clicks on the main CTA. And if there are clicks on any other element, the diagnosis is easy—the element looks clickable. There are a few heatmaps however, that are just plain confusing. Consider a heatmap having equally distributed clicks
            • Did you know?#3: How to target and run your experiment based on custom audience segments in PageSense

              Whatever kind of online business you're running, defining your target audience is the key factor to delivering relevant messages and further positioning your brand in the industry. Most marketing efforts revolve around this basic strategy of segmenting
            • Did you know?#2: How to filter your report by custom date range in PageSense

              Do you want to quickly view your experiment analysis or responses over different time periods? Want to effortlessly compare the performance of your website by specific weeks, months, or years? Also, see whether your new marketing strategies or efforts
            • Did you know?#1: How to filter reports based on different audience segments in PageSense

              Hey everyone, Over recent years, our customer support team has been getting queries asking I have this special requirement, and is it possible to achieve that with PageSense?" Fortunately, they were able to say "Yes" to most of them while providing an

            Zoho Pagesense Resources

              Zoho SalesIQ Resources



                    Zoho TeamInbox Resources

                      Zoho DataPrep Resources



                        Zoho CRM Plus Resources

                          Zoho Books Resources


                            Zoho Subscriptions Resources

                              Zoho Desk Resources

                                Zoho Projects Resources


                                  Zoho Sprints Resources


                                    Qntrl Resources


                                      Zoho Creator Resources


                                        Zoho WorkDrive Resources





                                            Zoho Campaigns Resources

                                              Zoho CRM Resources

                                                      Design. Discuss. Deliver.

                                                      Create visually engaging stories with Zoho Show.

                                                      Get Started Now