use test_file_finder mapping to spot flaky tests
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
Release notes
Problem to solve
As a developer reviewing an MR, I want to quickly identify which failed tests could be flaky, so that I can focus on fixes to code I really broke.
This could be a nice iteration on #241759 (closed)
Proposal
If a user has implemented mapping via test_file_finder we should be able to figure out a test maps to a file that changed or not and then message that in the Test Summary Widget like this, but you know with better words.
- Hey we noticed this test failed and you changed code related to it, so go look at your code.
- Hey we noticed this test failed but you didn't change code related to it . . but it hasn't failed before, that's weird maybe it's flaky?!
- Hey we noticed this test failed and it's failed in a few of the last runs but not all of them, it could be flaky.
Edited by 🤖 GitLab Bot 🤖