Test Execution Summary Data for projects - internal end point only
Release notes
Problem to solve
As an app dev director I want to see what % of tests are running/passing for a project over time.
Intended users
Hypothesis
If we provide Team Managers/group directors the trend of how many/what % of tests passed/failed in a project over the last 90 days they will use this to identify projects with potential for escaped defects.
- Delaney (Development Team Lead) - who wants to see if more tests are passing (number and percentage) over time in their projects. They also can see if more tests are being skipped, a leading signal in a test being flaky.
User experience goal
The user should be able to navigate from the project summary to a single page/tab to see overall what number and percentage of tests run, fail, are skipped and error out in the project's default branch today and how it trends over time.
Proposal
- Create an end point that provides the data (number of tests ran, skipped, passed, failed, error) that can be surfaced on the Project Quality Dash as the latest data and to compare against some time ago.
- Showing a comparison data point will be validated during solution validation and may change this requirement slightly.
Further details
- This feature will start at GitLab Ultimate
- We may build a bigger report view from this in the future but nothing for now.
Permissions and Security
Documentation
Availability & Testing
Available Tier
This is supporting an GitLab Ultimate feature initially but may be used for GitLab Premium features in the future.
What does success look like, and how can we measure that?
Acceptance Criteria
- The end point returns the most recent data for the default branch
- The end point can return data from a specific date in the past (up to 90 days back)
Measures of succees
N/A - The measures of success will be on the Epic.
What is the type of buyer?
Is this a cross-stage feature?
No
Links / references
Edited by James Heimbuck