FY22-Q4 KR: Evaluate the experience of 7 product categories and make recommendations to improve learnability
Objective: Improve SUS through evaluation and user feedback
For this KR, we will evaluate the usability of several Stage Groups by conducting a heuristic evaluation using our UX Scorecard process (Option A).
These UX Scorecards come with a slight twist! Designers will be paired and asked to evaluate an area of the product they do not currently work or are less familiar with. The goal is to attempt to complete a Job within our tool while "wearing the hat" of a new or newer user to help identify areas for usability and learnability improvements. We know from FY22-Q1 UX Research interviews that learnability was the most common reason why GitLab wasn't easy to use.
Please note: JTBDs must have a high level of confidence before we put them into use. If a group has a high level of confidence then a round of research to "validate" is not necessary. Our JTBD should be grounded by previous experience and research.
Overview of how it works
Please view the Heuristic Buddy template for detailed instructions on how to complete this evaluation.
The UX Scorecard plan is prepared by the Group Product Designer but then evaluated by another product designer or Heuristic Buddy that is not affiliated with the Stage Group.
Once the group product designer has created the UX Scorecard issue, provide a link to that issue in their team's list-item below. When the Heuristic Buddy has completed their evaluation and the Group Product Designer has created their recommendation issues, each should check off the appropriate row below for their team.
Evaluations (Group Product Designer | Heuristic Buddy | Group | Issue link)
@annabeldunstone | @esybrant | groupcode review | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@katiemacoy | @uhlexsis | ~"group::package" | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@npost | @emilybauman | groupoptimize | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@nadia_sotnikova | @jareko | grouppipeline authoring | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@mfangman | @mle | Secure & Protect Scanner | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@hollyreynolds | @mnearents | groupproject management | issue (redux to capture missed use case)
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
@sunjungp | @dmoraBerlin | groupdistribution | issue
-
Plan is complete and ready for Heuristic Buddy -
Heuristic review is complete -
Recommendation issue(s) have been written
The above list of 7 is locked (
Schedule
1. Group Product Designer:
- Create the scorecard issue using the template and link it to your list-item above
- Select the Job to be evaluated and associated persona(s) and update your issue
- Ping your Heuristic Buddy informing them you're ready for them to perform the evaluation:
- Due 2021-11-20
- Average time to complete:
- 10 mins to create
- 15 min conversation with PM to select Job
- 45 mins to update issue with plan
2. Heuristic Buddy:
- Complete the evaluation
- Create walkthrough and ping Group Product Designer when done
- Due 2021-12-17
- Average time to complete:
- 2-3 hours
3. Group Product Designer:
- Complete recommendation issue (please feel free to collaborate with your Heuristic Buddy on this as well)
- Due 2022-01-15 (occurs after Heuristic Buddy completes their review)
- Average time to complete:
- 2-3 hours