Post list of (QA) tests that have been quarantined relevant to MRs
Problem
Currently, engineers needs to be aware of currently quarantined QA tests in order to know whether test coverage in a certain area is disabled. This can lead to incidents such as this one: Incident Review: An error occurred in the purch... (gitlab-com/gl-infra/production#17354 - closed).
See relevant conversation here: https://gitlab.com/gitlab-com/feature-change-locks/-/issues/56#note_1715727682.
Proposal
Post currently quarantined QA tests on MRs that touch code relevant to quarantined tests.
The relevancy can be achieved in a couple of different ways:
- Somehow determine spec relevancy based on file changes in MR, similar to
jest
s--findRelevantTests
-option: https://stackoverflow.com/a/51502218/1008519. - Match section label, e.g. devopsfulfillment, from change to lists of quarantined tests
Result
Brings visibility to quarantined tests that are related to current change.
Edited by Michael Lunøe