Set up process for regular review of e2e tests to proactively promote to reliable
We should set up some process to surface tests which have met the reliable criteria and could be promoted.
Once we have pass rate of the whole QA test suite https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/985, we can use this to drill down to individual tests to find ones that are ready.
- V1 first iteration
-
Weekly automated triage report containing tests that have been reliable over the past week -
Counterpart SETs should review and decide whether or not to promote, create MRs as needed
-
- V2
-
Add to above report any tests that are reliable but have failed, for review and potential demotion
-
- V3
-
Create MRs automatically for tests that could be promoted or demoted
-
Edited by Andrejs Cunskis