A few tests are creating thousands of test health issues
Problem statement
Those two test files created 4000+ test health issues (1, 2).
It is most likely related to Remove :failed category when receiving a non-su... (gitlab-org/gitlab!166329 - merged).
Goals
- Ensure we stop those test health issues from being created
- Think about adapting automation to prevent future ones
- (Optional) Fix the original test flakiness
Exit Criteria
-
We quarantined the test files -
(Optional) We fixed the underlying flakiness issue -
I proposed solutions in Fix test, and ensure the test description doesn... (gitlab-org/gitlab!186589 - closed)
-
-
We ensure the RSpec test description does not contain a timestamp (this is until a more general fix is available) -
We cleaned up those test health issues
Edited by David Dieulivol