Add new Test Platform PI - Percentage and number of quarantined end-to-end by DevOps Stage and entire suite
Problem
We currently quarantine end-to-end tests that qualify a certain criteria however, a test may remain in quarantine for an extended period without receiving any attention costing us reduction in coverage. We would like to know the health of the test suite in terms of how many tests are in quarantine and their age in quarantine.
Solution
Create a PI that measures % as well as the number of the end-to-end quarantined per DevOps stage/entire suite as well as a list of end-to-end tests in quarantine along with their age filterable by DevOps stage.
Details
- Identify the total no of test cases in each DevOps stage and the entire test suite
- Display the no of tests and the percentage quarantined in each DevOps stage
- Display the total no of tests and percentage quarantined in the entire suite
- Add new PI to the Test Platform PI section
- List the quarantined tests along with age in quarantine sorted by oldest first and filterable by DevOps Stage.
- Define a target % of quarantined tests to be maintained
Edited by Sanad Liaquat