Skip to content

E2E: Custom rspec formatter to track QA test suite health

Andrejs Cunskis requested to merge acunskis-spec-metadata-formatter into master

What does this MR do?

  • Add custom rspec formatter to track suite health data by exporting metrics to influxdb
    • passed tests
    • failed tests
    • quarantined tests
    • reliable tests
    • retry attempts
    • test run time
  • Move formatters to separate module

Screenshots

Example grafana dashboards:

Malformed graph in the beginning is due to some data not exporting correctly during development process

image image image image

First iteration of tracking health test health metrics: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/985

Edited by Andrejs Cunskis

Merge request reports