Skip to content

E2E: Update reliable spec report creation

Andrejs Cunskis requested to merge acunskis-reliable-report into master

What does this MR do and why?

Describe in detail what your merge request does and why.

  • Fetch data from multiple run types to make sure test is stable on all environments
  • Create one report issue for stable specs and reliable specs with failures
  • Post only summary tables to slack and link to report issue

Related issue: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/994

Screenshots or screen recordings

Example report: #347413 (closed)

Running locally

bundle exec rake reliable_spec_report

Bear minimum, command requires following variables:

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Andrejs Cunskis

Merge request reports