Report custom metrics at the Job level
Problem to solve
Currently, a user can save custom metrics in OpenMetrics format via a metrics.txt
or similar file and these are displayed in merge requests. It would be useful to be able to display these at the job level so that one could compare metrics in the Job or Pipeline pages.
Intended users
Further details
I am thinking of my use-case where I fit and test machine-learning models on CI. Performance metrics are determined at build time, rather than deployment, and I want to be able to track changes in metrics as my model code changes.
Proposal
Place custom metrics in an additional column similar to "Coverage" in the Jobs page. If >1 metric, display the first and the rest via a tooltip. Metrics may be an additional field exposed in the API for Jobs.
Risks
Potential visual clutter.
What does success look like, and how can we measure that?
?
What is the type of buyer?
Users using GitLab for data science workflows.