Results | Zoho QEngine Help

Results

In a nutshell
Results is a real-time dashboard that displays the execution status of test plans, both manual and automated. It surfaces key metrics like total runs, completed runs, active runs, and success rate for a specified period. You can filter and sort results by platform, status, or time range to quickly identify failures, track testing trends, and drill into individual test case outcomes.

Overview

The results page is a real-time dashboard of manual or scheduled executions of your test plans. Test plans are schedules which automate the execution of test suites comprising of test cases.

All insights regarding execution times, trends, failures, and environments are displayed for quick reference.

View real-time execution status

The results page provides the execution status of your test plans.



  1. Total Execution Runs displays the total number of test plans executed for a specified period.
  2. Completed displays the number of executions completed.
  3. Running displays the number of executions that are in progress.
  4. Success Rate displays the percentage of test cases that succeeded against the total number of test cases executed for all runs.

Customize views

Search, sort, and filter test plan execution results. Toggle between list view and grid view. Derive insights by supplying the required parameters and see how test plans perform.



Search Test Plans

Search results for a required test plan with its name and view its executions.

Sort Test Plan execution results

Sort executions in an ascending or descending order based on their execution status – Failed, Passed, Duration (execution time), Start Time (execution start time).



Filter Test Plan execution results

Filter results based on the parameters - Data Range, Status, and Test Plan. The filter also provides an advanced filter option.

Filter by Data Range

Filter execution based on predefined date ranges - Today, Yesterday, Last 7 days, or Last 30 days.

Another option is to filter using a custom date range.

Click Apply to filter the results. To reset the filtering criteria, click Clear All.

Filter by Status

Filter results based on Status – Running, Completed, Stopped, or Terminated.

Filter by Test Plan

View test execution results by filtering them for a particular test plan.

Advanced Filter

Customize viewing test results using the available filters – Date, Status, Duration, Test Plan, and Platform. Derive insights by using them individually or in combination with each other.

Filter by Duration

Click the Duration drop down and select durations ranging from Lesser than 1 hour to Greater than 5 hours, spaced 1 hour between each other.

Filter by Platform

Click Platform drop down and select a required platform - Web, Android, iOS, and API to filter the results.

Click Apply to filter the results. To reset the filtering criteria, click Clear All. 

Toggle between Views

Grid View

The Grid view is the default view that groups results with test plan name. Each entry is a test plan execution for the chosen environments.


It presents comprehensive information regarding a single test plan execution. Let's take a look at each one of them.

1 - Name of the test plan being executed.

2 - Status of the test plan execution.

3 - Started On represents the time when the test plan execution started.

4 - Duration represents the time for which the current test plan is being executed.

5 - Overall Result represents the progress of the test plan execution. 

6 - Variables  represents the variables or environment variables defined for the test plan.

7 - Test case progress breakdown shows the number of test cases that currently are executed - Passed, Failed, and Remaining.

8 - Platform details display the environments chosen for the test plan execution.

9 - Results show the breakdown of the test cases based on their execution status.

10 -  Results Trend (Last 5) represents the success-failure ratio of a test plan execution from the last 5 times it was run.

11 - Duration Trend (Last 5) represents the duration a test plan execution took to complete from the last 5 times it was run.

List View

The List view displays a test plan execution for a selected environment as an individual entry. The screen below displays {three} entries for the test plan - {Test Plan}, one for each environment.



In the Grid View, this would have been a single entry with all the selected environments listed within it.

Test Plan Execution Results Drill-Down

Click any of the listed test plan execution results to view test case details.



1 - Name of the test plan that is executed.

2 - The type of run (available while creating plans - weekly or once) of the test plan.

3 - This section represents the environment for which the test plan was executed. When there is more than one environment, the test case execution details are displayed based on the environment selected.

Notes
Note: If any of the test plan need a re-run, click on the re-run icon beside the search bar, respectively these manual re-runs will get reflected inside results.

View Real-Time Status

The test case results page provides the execution status of your test cases.



  1. Total Test Cases displays the total number of test cases available in the test plan.
  2. Passed shows the number of test cases that passed.
  3. Failed shows the number of test cases that failed.
  4. Success Rate displays the percentage of test cases that succeeded against the total number of test cases executed.

Customize Views

Search, sort, and filter test case results. Derive insights by supplying the required parameters and see how your test cases perform.


Search Test Cases

Search for a required test case with its name.

Sort Test Case Results

Sort test case execution results in an ascending or descending order based on the duration.



Filter Test Case Results

Filter results based on the parameters -  Suite Name and Status (All, Completed, Passed, or Failed).



Click Apply to filter the results. To reset the filtering criteria, click Clear All.
  1. Test Case Summary














        Create. Review. Publish.

        Write, edit, collaborate on, and publish documents to different content management platforms.

        Get Started Now


          Access your files securely from anywhere

            Zoho CRM Training Programs

            Learn how to use the best tools for sales force automation and better customer engagement from Zoho's implementation specialists.

            Zoho CRM Training
              Redefine the way you work
              with Zoho Workplace

                Zoho DataPrep Personalized Demo

                If you'd like a personalized walk-through of our data preparation tool, please request a demo and we'll be happy to show you how to get the best out of Zoho DataPrep.

                Zoho CRM Training

                  Create, share, and deliver

                  beautiful slides from anywhere.

                  Get Started Now


                    Zoho Sign now offers specialized one-on-one training for both administrators and developers.

                    BOOK A SESSION







                                Quick LinksWorkflow AutomationData Collection
                                Web FormsEnterpriseOnline Data Collection Tool
                                Embeddable FormsBankingBegin Data Collection
                                Interactive FormsWorkplaceData Collection App
                                CRM FormsCustomer ServiceAccessible Forms
                                Digital FormsMarketingForms for Small Business
                                HTML FormsEducationForms for Enterprise
                                Contact FormsE-commerceForms for any business
                                Lead Generation FormsHealthcareForms for Startups
                                Wordpress FormsCustomer onboardingForms for Small Business
                                No Code FormsConstructionRSVP tool for holidays
                                Free FormsTravelFeatures for Order Forms
                                Prefill FormsNon-Profit

                                Intake FormsLegal
                                Mobile App
                                Form DesignerHR
                                Mobile Forms
                                Card FormsFoodOffline Forms
                                Assign FormsPhotographyMobile Forms Features
                                Translate FormsReal EstateKiosk in Mobile Forms
                                Electronic Forms
                                Drag & drop form builder

                                Notification Emails for FormsAlternativesSecurity & Compliance
                                Holiday FormsGoogle Forms alternative GDPR
                                Form to PDFJotform alternativeHIPAA Forms
                                Email FormsFormstack alternativeEncrypted Forms

                                Wufoo alternativeSecure Forms

                                TypeformWCAG

                                  Zoho FSM Video Tutorials


                                        All-in-one knowledge management and training platform for your employees and customers.

                                                  Create. Review. Publish.

                                                  Write, edit, collaborate on, and publish documents to different content management platforms.

                                                  Get Started Now




                                                                    You are currently viewing the help pages of Qntrl’s earlier version. Click here to view our latest version—Qntrl 3.0's help articles.




                                                                        Manage your brands on social media


                                                                          • Desk Community Learning Series


                                                                          • Digest


                                                                          • Functions


                                                                          • Meetups


                                                                          • Kbase


                                                                          • Resources


                                                                          • Glossary


                                                                          • Desk Marketplace


                                                                          • MVP Corner


                                                                          • Word of the Day


                                                                          • Ask the Experts


                                                                            Zoho Sheet Resources

                                                                             

                                                                                Zoho Forms Resources


                                                                                  Secure your business
                                                                                  communication with Zoho Mail


                                                                                  Mail on the move with
                                                                                  Zoho Mail mobile application

                                                                                    Stay on top of your schedule
                                                                                    at all times


                                                                                    Carry your calendar with you
                                                                                    Anytime, anywhere




                                                                                          Zoho Sign Resources

                                                                                            Sign, Paperless!

                                                                                            Sign and send business documents on the go!

                                                                                            Get Started Now




                                                                                                    Zoho TeamInbox Resources





                                                                                                              Zoho DataPrep Demo

                                                                                                              Get a personalized demo or POC

                                                                                                              REGISTER NOW


                                                                                                                Design. Discuss. Deliver.

                                                                                                                Create visually engaging stories with Zoho Show.

                                                                                                                Get Started Now








                                                                                                                                    • Related Articles

                                                                                                                                    • Test Case Summary for DDT

                                                                                                                                      In a nutshell The test case summary for data-driven testing shows the consolidated results of a data-driven test case. Each iteration captures the input data used and its outcome, making it easy to analyze which datasets passed or failed. You can ...
                                                                                                                                    • Run History

                                                                                                                                      In a nutshell Run History maintains a record of test case executions across web, Android, iOS, and API platforms for test plan runs. For each test case, you can view a pass or fail breakdown, root cause failure analysis based on element exceptions, ...
                                                                                                                                    • Reporting bugs in test cases from Zoho QEngine with Jira

                                                                                                                                      What does this page cover Learn how to report bugs from test case executions using the Jira integration. Before you begin, it's essential to understand how the Jira integration works and its configuration. Availability This feature is available on ...
                                                                                                                                    • Live Preview

                                                                                                                                      In a nutshell Live preview gives you real-time execution results for an automated test case, letting you observe each step as it runs and detect potential errors before committing to a full test plan execution. To run a live preview, you configure a ...
                                                                                                                                    • Live Preview for Data-Driven Testing

                                                                                                                                      In a nutshell Live preview for data-driven testing lets you observe each iteration of a data-driven test case executing in real time before adding it to a suite or test plan. Logs update automatically with each iteration, capturing the inputs ...
                                                                                                                                      Wherever you are is as good as
                                                                                                                                      your workplace

                                                                                                                                        Resources

                                                                                                                                        Videos

                                                                                                                                        Watch comprehensive videos on features and other important topics that will help you master Zoho CRM.



                                                                                                                                        eBooks

                                                                                                                                        Download free eBooks and access a range of topics to get deeper insight on successfully using Zoho CRM.



                                                                                                                                        Webinars

                                                                                                                                        Sign up for our webinars and learn the Zoho CRM basics, from customization to sales force automation and more.



                                                                                                                                        CRM Tips

                                                                                                                                        Make the most of Zoho CRM with these useful tips.



                                                                                                                                          Zoho Show Resources