Category Maturity of Subgroups 2021-01

Category Maturity Scorecard Checklist

Learn more about Category Maturity Scorecards

  1. Review the Category Maturity Scorecard handbook page and follow the process as described. Reach out to the UX Researcher for your stage if you have questions.
  2. Document the results of each JTBD scenario using this template
  3. Add links for each participants' session recordings. Consider downloading the session videos from Zoom, and uploading them to the shared Google UX Research folder in the appropriate section/stage/project folder.
  4. If the participant has not granted permission to share the recording publicly, ensure the sharing settings are set to GitLab-only.
  5. If needed, create a recommendation issue for these sessions.

CM Scorecard Results Template

🗓 Google Spreadsheet calculator

# GitLab User Scenario 1 Scenario 2 Scenario 3 Scenario 4 Scenario 5 Scenario 6 Score Averages
P1 5-5 5-5 1-1 5-5 1-1 4-5 3.58
P2 5-5 5-5 5-5 5-5 5-5 5-5 5
P3 5-5 5-5 5-5 5-5 4-4 2-4 4.5
P4 4-5 5-4 3-5 5-5 3-4 2-1 3.83
P5 4-5 5-5 5-5 1-X(confusion) 1-1 3.42
P6 5-4 5-3 5-5 5-5 5-5 3-4 4.17
P7 5-5 5-4 5-3 5-5 2-1 4-2 3.83
= = = = = = ---
CMS: 4.08 4.8 4.9 4.14 4.71 2.86 3.07

Jobs to be done

  1. When I want to organize my resources, I need to be able to create groupings that represent my organization so I can manage permissions effectively.
  2. When I want to manage a group's membership, I need to have granular access controls for the group members, so I can ensure strict compliance and security protocol enforcement.
  3. When I want to grant access to resources, I need to be able to give users and groups of users the proper access so that I can enable them to do their work while keeping my intellectual property secure.

Scenarios

Scenario 1
Scenario 2
  • Prompt - Please add 3 users to the Application Database Services group.
  • Average UMUX Lite score for capabilities - {{score}}
  • Average UMUX Lite score for ease of use - {{score}}
  • How many participants were successful at the task - {{number of successful participants/out of total participants}}
  • How many participants failed the task - {{number of participants who failed/out of total participants}}
  • Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 3
  • Prompt - Please share the Application Database Services group to Project Core and Project Zeta.
  • Average UMUX Lite score for capabilities - {{score}}
  • Average UMUX Lite score for ease of use - {{score}}
  • How many participants were successful at the task - {{number of successful participants/out of total participants}}
  • How many participants failed the task - {{number of participants who failed/out of total participants}}
  • Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 4
  • Prompt - Create a new top level group for the Product Managers to track their team’s work. Within this new group, create an epic called Increase Revenue.
  • Average UMUX Lite score for capabilities - {{score}}
  • Average UMUX Lite score for ease of use - {{score}}
  • How many participants were successful at the task - {{number of successful participants/out of total participants}}
  • How many participants failed the task - {{number of participants who failed/out of total participants}}
  • Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 5
  • Prompt - Setup permissions such that Members of Business Process Management can associate their Issues and Epics to the Increase Revenue Epic in the Product Managers Group.
  • Average UMUX Lite score for capabilities - {{score}}
  • Average UMUX Lite score for ease of use - {{score}}
  • How many participants were successful at the task - {{number of successful participants/out of total participants}}
  • How many participants failed the task - {{number of participants who failed/out of total participants}}
  • Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 6
  • Prompt - Create a user that can assign issues from Project Blank to the epic in Digital Transformation Environment group.
  • Average UMUX Lite score for capabilities - {{score}}
  • Average UMUX Lite score for ease of use - {{score}}
  • How many participants were successful at the task - {{number of successful participants/out of total participants}}
  • How many participants failed the task - {{number of participants who failed/out of total participants}}
  • Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}

Participants

Participant 1
  • senior software engineer
  • Top 3 tasks/responsibilities
    • system and application monitoring
    • builds monitoring
    • QA assistance
  • Previous/current GitLab usage: ~3yrs
  • Interview
Participant 2
  • CTO
  • Top 3 tasks/responsibilities
    • Fill backlog for devs
    • Planning and designing product
    • talking to customers to get feedback
  • Previous/current GitLab usage: 1.5yr
  • Interview
Participant 3
  • Senior devops engineer
  • Top 3 tasks/responsibilities:
    • version control
    • running pipelines / writing pipeline code
    • kubernetes integration
  • Previous/current GitLab usage: 5yrs
  • Interview
Participant 4
  • IT Support engineer
  • Top 3 tasks/responsibilities:
    • support end user (trouble shooting hardware/software)
    • manage and monitor help desk
    • troubleshooting authentication issues
  • Previous/current GitLab usage: zero
  • Interview
Participant 5
  • senior dev ops engineer
  • Top 3 tasks/responsibilities
    • manage jenkins instances
    • build teraform code
    • manage teraform code
  • Previous/current GitLab usage: ~5yrs
  • Interview
Participant 6
  • Infrastructure engineer
  • Top 3 tasks/responsibilities
    • Building and managing infrastructure for dev teams
    • monitoring servers
    • assisting users with issues
  • Previous/current GitLab usage: very little/not often.
  • Interview
Edited by Daniel Mora