UX Theme: Reduce the time it takes for a developer to debug a failing test job
UX Theme
🐛 Reduce the time it takes for a developer to debug a failing test job
Beneficiary
Need & JTBD
- JTBD: When new or existing tests are failing in a build, I want to be able to identify them and where they are in the code as easily as possible, so that I can fix them quickly and get back to pushing features into production.
- Need: Quickly understand the failing jobs and fix them
Business objective
Increase user efficiency, customer experience, and ideally increase adoption.
Confidence
Confidence | Research |
---|---|
High | Solution validation: Artifacts page |
Subthemes
Feature/solution subthemes
Opportunity | Issue link | UX Weight | Workflow status |
---|---|---|---|
Detect flaky tests MVC | #381799 | workflowdesign | |
Allow downloading artifacts from latest successful job | #300033 | design-weight2 | workflowready for design |
Visualize artifacts inputs and outputs of jobs and pipelines | #363412 | design-weight3 | workflowready for design |
Test Summary on MR only presents one test failure even if multiple are present | #26251 | workflowstart | |
Automatic flaky test minimization | #3583 | workflowstart | |
Improve communication when an artifact is expired | #365473 | design-weight3 | workflowready for design |
Allow artifacts to be compared after a failure | #365477 | design-weight3 | workflowready for design |
Filter by branch name on artifacts page | #367294 | design-weight1 | workflowin dev |
Filter by job name (string) | #377734 | design-weight1 | workflowplanning breakdown |
Add more information to project-level build artifacts page | #33418 (closed) | design-weight5 | workflowin review |
Artifacts page performance issues | #32281 (closed) | closed |
Research subthemes
Opportunity | Issue link | Research type |
---|---|---|
Solution validation: Artifacts page | https://gitlab.com/gitlab-org/ux-research/-/issues/1859 | solution validation |
Solution validation: Flaky tests MVC | https://gitlab.com/gitlab-org/ux-research/-/issues/2263 | workflowsolution validation |
Improve where build artifacts are located | #351672 | workflowvalidation backlog |
Edited by Gina Doyle