Quarantine a flaky test

The Users::UnconfirmedUsersDeletionCronWorker#perform when setting for deleting unconfirmed users is set stops after ITERATIONS of BATCH_SIZE test matches one of the following conditions:

1. has either flakiness1 or flakiness2 label set, which means the number of reported failures is at or above 95 percentile, indicating unusually high failure count.

2. has severity1 label set, which means the number of reported failures spiked and exceeded its daily threshold.

This MR quarantines the test. This is a discussion starting point to let the responsible group know about the flakiness so that they can take action:

• accept the merge request and schedule the associated issue to improve the test
• close the merge request in favor of another merge request to delete the test

Please follow the Flaky tests management process to help us increase master stability.

Please let us know your feedback in the Engineering Productivity issue tracker.

Related to #484683 (closed).

This change was generated by gitlab-housekeeper using the Keeps::QuarantineFlakyTests keep.

To provide feedback on your experience with gitlab-housekeeper please create an issue with the label GitLab Housekeeper and consider pinging the author of this keep.

added automation:gitlab-housekeeper-authored failureflaky-test groupauthentication maintenancerefactor pipelineexpedited quarantine quarantineflaky test labels

requested review from @sgarg_gitlab

added devopsgovern sectionsec typemaintenance labels

added 1 commit

• 1515702c - Quarantine a flaky test

Compare with previous version

added backend label

	4 Warnings
	This MR changes code in ee/, but its Changelog commit is missing the EE: true trailer. Consider adding it to your Changelog commits.
	c605c6a0: The commit body should not contain more than 72 characters per line. For more information, take a look at our Commit message guidelines.
	This merge request does not have any assignee yet. Setting an assignee clarifies who needs to take action on the merge request at any given time.
	This merge request does not refer to an existing milestone.

Reviewer roulette

Category	Reviewer	Maintainer
backend	@jwanjohi (UTC+1)	@msaleiko (UTC+2)

Please refer to documentation page for guidance on how you can benefit from the Reviewer Roulette, or use the GitLab Review Workload Dashboard to find other available reviewers.

If needed, you can retry the danger-review job that generated this comment.

Generated by Danger

added automation:bot-authored label

added 164 commits

• 1515702c...851173aa - 163 commits from branch master
• f9924218 - Quarantine a flaky test

Compare with previous version

added 5 commits

• f9924218...b00a2295 - 4 commits from branch master
• 9e71e6e6 - Quarantine a flaky test

Compare with previous version

added 23 commits

• 9e71e6e6...a7ddc868 - 22 commits from branch master
• c85378cb - Quarantine a flaky test

Compare with previous version

added 253 commits

• c85378cb...8c8156ab - 252 commits from branch master
• 26371c0c - Quarantine a flaky test

Compare with previous version

added 296 commits

• 26371c0c...ce90fbc9 - 295 commits from branch master
• 0e3eefeb - Quarantine a flaky test

Compare with previous version

added 278 commits

• 0e3eefeb...a0abf326 - 277 commits from branch master
• 9c669dd4 - Quarantine a flaky test

Compare with previous version

added 207 commits

• 9c669dd4...4a145569 - 206 commits from branch master
• 83709b7f - Quarantine a flaky test

Compare with previous version

added 222 commits

• 83709b7f...9961ba60 - 221 commits from branch master
• a499f7b0 - Quarantine a flaky test

Compare with previous version

added 11 commits

• a499f7b0...84c34e47 - 10 commits from branch master
• 2ca83ad0 - Quarantine a flaky test

Compare with previous version

added 23 commits

• 2ca83ad0...98e18ff1 - 22 commits from branch master
• f78b8f5d - Quarantine a flaky test

Compare with previous version

added 265 commits

• f78b8f5d...f7193b84 - 264 commits from branch master
• c1a8e75d - Quarantine a flaky test

Compare with previous version

added 17 commits

• c1a8e75d...4a416cd4 - 16 commits from branch master
• 85136d40 - Quarantine a flaky test

Compare with previous version

added 233 commits

• 85136d40...1d90aa03 - 232 commits from branch master
• c605c6a0 - Quarantine a flaky test

Compare with previous version

approved this merge request

I am approving this MR and scheduling the flaky test issue for next milestone

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1153 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1154 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1156 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1158 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1160 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1161 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1162 (closed)

mentioned in incident gitlab-org/quality/engineering-productivity/approved-mr-pipeline-incidents#1163 (closed)

merged

mentioned in commit 1d359a98

added workflowstaging-canary label

added workflowcanary label and removed workflowstaging-canary label

changed milestone to %17.5

added workflowstaging label and removed workflowcanary label

added workflowproduction label and removed workflowstaging label

added workflowpost-deploy-db-staging label and removed workflowproduction label

added workflowpost-deploy-db-production label and removed workflowpost-deploy-db-staging label

added releasedcandidate label

added releasedpublished label and removed releasedcandidate label

mentioned in merge request kubitus-project/kubitus-installer!3429 (merged)