Skip to content

Quarantine a flaky test

Auto-quarantining bot requested to merge quarantine-flaky-tests-spec-serializers-test_report_summary_entity_spec-rb-16 into master

The TestReportSummaryEntity#as_json when summary has test suites contains the test suites test matches one of the following conditions:

  1. has either flakiness1 or flakiness2 label set, which means the number of reported failures is at or above 95 percentile, indicating unusually high failure count.

  2. has severity1 label set, which means the number of reported failures spiked and exceeded its daily threshold.

This MR quarantines the test. This is a discussion starting point to let the responsible group know about the flakiness so that they can take action:

  • accept the merge request and schedule the associated issue to improve the test
  • close the merge request in favor of another merge request to delete the test

Please follow the Flaky tests management process to help us increase master stability.

Please let us know your feedback in the Engineering Productivity issue tracker.

Related to #463029 (closed).

This change was generated by gitlab-housekeeper using the Keeps::QuarantineFlakyTests keep.

To provide feedback on your experience with gitlab-housekeeper please create an issue with the label GitLab Housekeeper and consider pinging the author of this keep.

Merge request reports