E2E: Custom rspec formatter to track QA test suite health
What does this MR do?
- Add custom rspec formatter to track suite health data by exporting metrics to influxdb
- passed tests
- failed tests
- quarantined tests
- reliable tests
- retry attempts
- test run time
- Move formatters to separate module
Screenshots
Example grafana dashboards:
Malformed graph in the beginning is due to some data not exporting correctly during development process
First iteration of tracking health test health metrics: https://gitlab.com/gitlab-org/quality/team-tasks/-/issues/985
Edited by Andrejs Cunskis