Create and manage Test Runs | Test Case Management | Zoho Sprints Help

Create and manage Test Runs

Test runs are actual tests that the Quality Analyst or Tester conducts for a feature or product. For example, any feature or product planned for release should do a test run before sending the feature live.

Create Test Run  

  1. Navigate to the required project.
  2. Select the Test Management module.
  3. Click the dropdown beside the Create button. 
  4. Select Test Run.
  5. In the Add Test Cases from field, select Project, Test Suite, or Existing Test Run. 

 Case 1: Project  

  1. All test cases available in the Test Management module of the selected project will be listed.
  2. The Criteria field is mandatory.
  3. Specify the criteria to fetch the required published test cases from the project.  

  4. From the search results in the right pane, select the required test cases. Alternatively, click Select All to select all the test cases in the search results.
  5. Click Create & Associate.

 Case 2: Test Suite   

  1. In the Test Suite field, select the required test suite.
  2. In the Cases to include field, select All Cases or Specific Cases. 

  3. If you select Specific Cases, specify the criteria to fetch the required test cases.
  4. Click Search & Associate.
  5. From the search results in the right pane, select the required test cases. Alternatively, click Select All to select all the test cases in the search results.
  6. Click Create & Associate.

 Case 3: Existing Test Run    

  1. In the Test Run field, select the required test run.
  2. In the Cases to include field, select All Cases or Specific Cases. 

  3. If you select Specific Cases, specify the criteria to fetch the required test cases.
  4. Click Search & Associate.
  5. From the search results in the right pane, select the required test cases. Alternatively, click Select All to select all the test cases in the search results.
  6. Click Create & Associate.
Notes
 Note:  
  1.  Only published test cases will be displayed in the Search Results and included in the Test Run.   
  2.  A maximum of 100 test cases from the test results can be selected manually.   

Multi-select and add Test Cases to Test Run

Create a customized test run by selecting only the test cases required for testing. 
  1. Navigate to the Test Cases module or to the respective test suite's details view. 
  2. Select the required test cases. 
  3. Click Create Run. 
  4. In the Run details page, enter the Run name, Description and Owner. 
  5. Click Create. 
Notes
Note: Only published test cases will be included to the test run. 

Rerun Test Cases  

Reuse the existing set of test cases from an existing test run without retaining their test results. This helps you quickly set up another testing cycle without manually adding the test cases again.

You can either create a new run with selected test cases or clone the existing run. This makes it easier to perform multiple testing cycles while maintaining traceability.
Prerequisites to create a test run using Rerun
  1. You must have permission to create test runs.
  2. The project must be active.
  3. The test cases must be published.
Notes
Note: Only the latest version of the test cases will be included to the new test run created using Rerun.

To Rerun a test run: 
  1. Navigate to Test Management in the required project.
  2. Go to the Test Run module. 
    List of all test test runs will be shown. 
  3. Hover over a test run and click Rerun.  

You can rerun test cases in two ways:
  1. Create Run
  2. Clone 


Case 1: Create Run 

All test cases of the existing run will be included. You have the choice to select All Cases of the Test Run or Specific Test cases, just like creating a new test run.
  1. All Cases: All test cases of the test run will be associated to the new run.
  2. Specific Cases: Select 'Specific Cases' to manually filter and pick the test cases you need. 

Case 2: Clone

Select Clone when you want to recreate the existing test run with the same configuration.

The cloned run retains the same name, owner, and test cases, but does not retain the test results. You can immediately start executing the test cases and record new results for the next testing cycle.

The title of the cloned test run includes to help you identify its source.
 
When you Clone an existing Test Run, the title will included <Cloned from> for easy identification. 


Notes
Note:
  1. Only published test cases are displayed in the search results and can be included in the test run.
  2. You can manually select a maximum of 100 test cases from the search results or click 'Select All' to select all test cases of the test run.

Lock Test Run   

You can restrict users from adding new test cases or removing existing test cases from the test run by locking the test run.

To lock a test run:
  1. Navigate to Test Management in the required project.
  2. Go to the Test Run module.
  3. Hover over a test run and click View Details.
  4. Select the Yes radio button in the Is locked? field.
    This action will restrict users from modifying the test cases. 

Other Actions in Test Run  

Edit Test Run  

  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Select a test run.
  4. Click the Other Actions icon.
  5. Select Edit. 

  6. Update the test run as per your requirement.
  7. Click Update.

Delete Test Run  

  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Select a test run.
  4. Click the Other Actions icon.
  5. Select Delete and confirm your action.

  6. Click Delete.

Close Test Run  

You can close the test run when all the test cases are executed. You can also close the test run mid-way in case your test cycle is aborted.

To close a test run,
  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Select a test run.
  4. Click the Other Actions icon.
  5. Click Close. Confirm your action.

  6. Click Close.
Alternatively, you can close the test run from its details page.
  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Click to open the required test run.
  4. Click Close Run at the top right.

  5. Click Close to confirm your action.
Notes
 Note:  
  1.  You wont be able to make any changes to the test cases associated in the test run once the test run is closed.   
  2.  You can delete or view the details of the test run once the test run is closed.  
  3.  If a test run is marked closed, it cannot be reopened again. 

Associate Test Cases to Test Run  

You can associate more test cases to the test run using the Associate Test Cases option.

To do so,
  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Select a test run.
  4. Click the Other Actions icon.
  5. Select Associate Test Cases.

  6. In Associate Test Cases page, choose a condition to associate test cases.
  7. Select Search & Associate.
    All the test cases matching the criteria will show up as results.
  8. Select all the required test cases and click Associate.
All the selected test cases will be added to the test run.

Reorder Test Cases in Test Run  

  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Select a test run.
  4. Hover over the position number to view the Reorder icon.
  5. Drag and drop the test cases in the required sequence. (or)
  6. Enter the position number in the sequence box to reorder the test cases. 

The test cases will be reordered as per your requirement.

Bulk actions

You can select multiple test cases within a test run to update their assignee and result fields, or to dissociate them from the test run.

To update multiple test cases:
  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Click to open the required test run.
    A list of all the associated test cases will appear.
  4. Select the checkbox beside the required test cases. The bulk actions will appear.
  5. Click the Update button and select Assignee or Result. 

  6. Select a value and click Update.
To dissociate test cases:
  1. Navigate to Test Management in a project.
  2. Go to the Test Run module.
  3. Click to open the required test run.
    A list of all the associated test cases will appear.
  4. Select the checkbox beside the required test cases to be dissociated.
  5. Click the Dissociate button.

  6. Confirm your action and click Dissociate.

View the statistics of test results  

In the Test Run module, you can view the results of the test cases executed so far. You can see the number of test cases listed under each test result.