Skip to content

ci: Use gitlab_quality-test_tooling to report test failures

Rémy Coutable requested to merge update-gitlab_quality-test_tooling-version-in-qa-gemfile-2 into master

What does this MR do and why?

This makes create-issues-for-failing-tests use the new gitlab_quality-test_tooling gem instead of the custom scripts/pipeline/create_test_failure_issues.rb script to report test failures.

This is part of Q2 OKR to consolidate tooling around test reporting, specifically iteration 2.

This currently creates issues in https://gitlab.com/gitlab-org-sandbox/rails-test-failures/-/issues for now for the following reasons:

  • assess the number of issues created
  • assess the accuracy of the de-duplication logic
  • ensure people subscribed to labels (e.g. group labels) aren't "spammed" by these issues

At any time, the automatic issue creation can be disabled by setting CREATE_RAILS_TEST_FAILURE_ISSUES to false.

Depends on !122173 (merged).

Examples

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Rémy Coutable

Merge request reports