UX Scorecard - Verify::Pipeline execution - FYQ3 - Analyse configured tasks across projects
- Personas: Delaney, Devon, Dakota
- JTBD : When analysing configured CI tasks at a higher level for my organization, I want an overall understanding of the historical data about them, so I can identify trends and opportunities for improvements.
-
Scenario: You are the development lead in your organization, overseeing three projects, all belonging to the same group. You want to ensure good health of the CI processes in the concerned projects by looking out for opportunities for optimization and by keeping the CI minutes consumption in check:
- In order to make optimizations, you need to get an overview of the current and past performance of pipelines and jobs in those projects
- To keep the usage in check, you need to keep an eye on the CI minutes consumption per project
- Set-up: GitPod snapshot | If that doesn't work - GitPod workspace You have been given owner permission to a group with 3 projects and pipeline runs. Credentials would be shared over slack.
- Previous score and scorecard: (hasn't been scored before)
- Benchmark score: Not scored previously
-
Walkthrough video:
🎥 Experience Walkthrough by Becka - Walkthrough deck: {{add link to deck used in Youtube video if applicable. This step is optional and we encourage you to skip this unless it helps you to communicate your findings}}
- New Score : 1.67
- Recommendations: #1672 (closed)
Heuristic Buddy UX Scorecard Checklist
The Heuristic Buddy UX Scorecards are a twist on our UX Scorecard process. These are specifically designed to help identify areas of usability and learnability improvements. They are to be completed by a designer who does not work within the same product area(s) the job can be completed in. Learn more about UX Scorecards
The initial preparation is completed by the Group Product Designer. When the preparation has been completed they will hand it over to the Heuristic Buddy to complete the evaluation who will hand it back to the Group Product Designer when completed to add any recommendations. Read through the steps below for details.
Group Product Designer (Expert)
-
Add this issue to the stage group epic for the corresponding UX scorecards. Verify that the "UX scorecard" label is applied. -
After working with your PM to identify a top job, write it using the Job to be Done (JTBD) format: When [situation], I want to [motivation], so I can [expected outcome]
. Review with your manager to ensure your JTBD is written at the appropriate level. Remember, a JTBD is not a user story, it should not directly reference a solution and should be tool agnostic. -
Make note of which personas might be performing the job, and link to them from this issue's description. Keeping personas in mind allows us to make the best decisions to address specific problems and pain points. Note: Do not include a persona in your JTBD format, as multiple types of users may complete the same job. -
If your JTBD spans more than one stage group, that’s great! Review your JTBD with a designer from that stage group for accuracy. Note: This stage group's designer cannot be your Heuristic Buddy. -
Consider whether you need to include additional scenarios related to onboarding. -
Ping your Heuristic Buddy and let them know it's ready for them to conduct the evaluation. -
Work with your Heuristic Buddy to ensure they'll be evaluating GitLab in the correct environment setup that is appropriate to a new user attempting to complete the JTBD that you've selected.
Heuristic Buddy (Evaluator)
-
Review the current experience, noting where you expect a user's high and low points to be based on our UX Heuristics. Using an experience map, such as the one found in this template, capture the screens and jot down observations. - During the evaluation strive to wear the hat of the persona relevant to the JTBD and while doing so try to see the UI from their perspective as if they were a new user.
- As you progress through your evaluation this will be easy to forget so it's recommended to put a reminder somewhere in your view, such as a post-it stuck on your monitor that says "You're a new user!"
-
Use the Grading Rubric to provide an overall measurement that becomes the Benchmark score for the experience (one grade per JTBD), and add it to this issue's description. Document the score in the UX Scorecard Spreadsheet. -
Once testing is complete, create a walkthrough video that documents what you experienced when completing the job in GitLab. Begin the video with a contextual introduction including: - Your role, stage group
- Specify how you conducted the heuristic evaluation
- Add a short introduction describing the JTBD and the purpose of the UX scorecard (i.e. you're performing the evaluation in partnership with {stage group} and {product designer}.
- This is not a "how-to" video, but instead should help build empathy for users by clearly showing areas of potential frustration and confusion. (You can point out where the experience is positive, too.)
- At the end of the video, make sure to include narration of the Benchmark Score. Examples here and here.
- The walkthrough video shouldn't take you long to create. Don't worry about it being polished or perfect, it's more important to be informative.
-
Post your video to the GitLab Unfiltered YouTube channel, and link to it from this issue's description: https://youtu.be/3BDF60NcLGU -
Link to your video in the Engineering Week in Review. -
Once the evaluation has been completed ping the Stage Group Product Designer in this issue letting them know it's ready for their review.
Group Product Designer (Expert)
-
Create a recommendation issue for this JTBD and add it to the same stage group epic as this issue. - Add a link to your recommendation issue(s) to this issue.
Edited by Veethika Mishra