FY22-Q3 KR: Evaluate the experience of 10 product categories and make recommendations to improve learnability
Objective: Improve SUS through evaluation and user feedback
For this KR, we will evaluate the usability of several Stage Groups by conducting a heuristic evaluation using our UX Scorecard process.
These UX Scorecards come with a slight twist! Designers will be paired and asked to evaluate an area of the product they do not currently work or are less familiar with. The goal is to attempt to complete a job within our tool while "wearing the hat" of a new or newer user to help identify areas for usability and learnability improvements. We know from FY22-Q1 UX Research interviews that learnability was the most common reason why GitLab wasn't easy to use.
Please note: JTBDs must have a high level of confidence before we put them into use. If a group has a high level of confidence then a round of research to "validate" is not necessary. Our JTBD should be grounded by previous experience and research.
How it works
Please view the Heuristic Buddy template for detailed instructions on how to complete this evaluation.
The UX Scorecard plan is prepared by the Group Product Designer but then evaluated by a pair Heuristic Buddy that is not affiliated with the Stage Group.
Once you've created your UX Scorecard issue, provide a link to the issue in the table below. When the evaluation is finished and the Group Product Designer has created their recommendation issues, they should check off their row.
Evaluations (Group Product Designer | Heuristic Buddy | Group | Issue link)
@v_mishra | @beckalippert | grouppipeline execution | gitlab-org/gitlab-design#1671 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@gdoyle | @gdoyle (@v_mishra mentor) | grouprunner | gitlab-org/gitlab-design#1666 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@nickbrandt | @sunjungp | groupglobal search | https://gitlab.com/gitlab-org/gitlab-design/-/issues/1679
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@dfosco | @cam.x | grouprelease | gitlab-org/gitlab-design#1670 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@aregnery | @dfosco | groupcompliance | gitlab-org/gitlab-design#1663 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@hollyreynolds | @matejlatin | groupproject management | gitlab-org/gitlab-design#1676 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@mnichols1 | @timnoah | groupsource code | gitlab-org/gitlab-design#1692 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@mfangman | @lvanc | Secure & Protect | gitlab-org/gitlab-design#1682 (closed)
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@uhlexsis | @mnichols1 | groupproduct planning | https://gitlab.com/gitlab-org/gitlab-design/-/issues/1689
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
@ameliabauerly | @kcomoli | ~"group::monitor" | Creating an on-call schedule
- Plan is complete and ready for Heuristic Buddy
- Heuristic review is complete
- Recommendation issue(s) have been written
The above list of 10 is locked (
Schedule
1. Group Product Designer:
- Create the scorecard issue using the template and link it to the table above
- Select the Job to be evaluated and associated persona(s) and update your issue
- Ping your Heuristic Buddy informing them you're ready for them to perform the evaluation:
- Due 2021-08-20
- Average time to complete:
- 10 mins to create
- 15 min conversation with PM to select Job
- 45 mins to update issue with plan
2. Heuristic Buddy:
- Complete the evaluation
- Create walkthrough and ping Group Product Designer
- Due 2021-9-17
- Average time to complete:
- 2-3 hours
3. Group Product Designer:
- Complete recommendation issue
- Due 2021-10-15 (occurs after Heuristic Buddy completes their review)
- Average time to complete:
- 2-3 hours
@gdoyle
KR plan for The UX Scorecard plan will prepared and evaluated by @gdoyle
since Gina is new to GitLab and is still understanding the technology and features of the stage group. @v_mishra
will act as Buddy (mentor) throughout the process, helping Gina setup the scorecard, answer questions about the process, and evaluate the experience.
Once Gina created the UX Scorecard issue, provide a link to the issue in the table above. When the evaluation is finished and the recommendation issues are created and reviewed by Veethika, they should check off their row.
Please view the UX Scorecard page for detailed instructions on how to complete this evaluation.
@gdoyle
Schedule for - Create the scorecard issue using the Part 1 - UX Scorecard template and link it to the table above
- With the help from your Buddy, select an appropriate approach for the Scorecard based on the time you have, the priority of the workflow to users, or whether or not this is a first Scorecard or an update
- Select the Job to be evaluated and associated persona(s) and update your issue
- Ping your Buddy informing them you're ready to start the evaluation:
- Due 2021-08-20
- Average time to complete:
- 10 mins to create
- 15 min conversation with PM (and Buddy) to select Job
- 45 mins to update issue with plan
- Complete the evaluation
- Create walkthrough and ping your Buddy
- Due 2021-9-17
- Average time to complete:
- 2-3 hours
- Create a recommendation issue using the Part 2 - Recommendations template, and complete recommendation issue
- Due 2021-10-15 (occurs after Heuristic Buddy completes their review)
- Average time to complete:
- 2-3 hours