Quality Engineering KPI - Build bug first triage (with stage/group and severity) metric into Periscope
Overview
Measure our speed to triage new issues. We currently have ~400 new issues every week in CE/EE. We need to go through all of them and identify valid issues and high severity bugs.
Measurement definition
The duration from issue creation to partial triage time for all ~bug issues in gitlab-org/gitlab
. This will be visualized as a Time Series chart showing the average duration by month.
Next steps:
-
Define an automated mechanism to detect first triage of a GitLab team member. - starting with description in https://gitlab.com/gitlab-org/quality/team-tasks/issues/136#note_211116724 -
Define measure mechanism and establish threshold. -
Fan-out triaging to all of engineering. First triage is mostly on the Quality Dept Eng Prod team. -
Expand this into first scheduled milestone.
We need to build this in Periscope and respect/update https://about.gitlab.com/handbook/engineering/quality/performance-indicators/.
Once finalized, the chart should go into https://app.periscopedata.com/app/gitlab/516343/Quality-KPIs.
Edited by Kyle Wiebers