Automatically create issues with relevant group label for flaky tests and potentially automatically quarantine tests automatically
Inspired by https://github.blog/2020-12-16-reducing-flaky-builds-by-18x/ and https://github.com/dmagliola/faster_ci, we should create a system to surface the most problematic flaky tests by:
- Creating issues automatically (similarly to how we do it for end-to-end failures) based on the "flaky report" from our FlakyListener (that we should generate on every MR: gitlab-org/gitlab!59387 (closed))
- Setting the relevant group labels
- Automatically quarantining them: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/1156
Edited by Rémy Coutable