Category Maturity of Subgroups 2021-01
- Research issue: https://gitlab.com/gitlab-org/ux-research/-/issues/992
- Previous score and scorecard: 2.0833 average = F https://gitlab.com/gitlab-org/gitlab-design/-/issues/1331
- UPDATED SCORE: 4.08
- Read about how this was calculated
- Walkthrough: {{add link to YouTube video or walkthrough document}}
- Recommendations: {{add link to your recommendation issue/s}}
Category Maturity Scorecard Checklist
Learn more about Category Maturity Scorecards
-
Review the Category Maturity Scorecard handbook page and follow the process as described. Reach out to the UX Researcher for your stage if you have questions. -
Document the results of each JTBD scenario using this template -
Add links for each participants' session recordings. Consider downloading the session videos from Zoom, and uploading them to the shared Google UX Research folder in the appropriate section/stage/project folder. -
If the participant has not granted permission to share the recording publicly, ensure the sharing settings are set to GitLab-only. -
If needed, create a recommendation issue for these sessions.
CM Scorecard Results Template
| # | GitLab User | Scenario 1 | Scenario 2 | Scenario 3 | Scenario 4 | Scenario 5 | Scenario 6 | Score Averages |
|---|---|---|---|---|---|---|---|---|
| P1 | 5-5 | 5-5 | 1-1 | 5-5 | 1-1 | 4-5 | 3.58 | |
| P2 | 5-5 | 5-5 | 5-5 | 5-5 | 5-5 | 5-5 | 5 | |
| P3 | 5-5 | 5-5 | 5-5 | 5-5 | 4-4 | 2-4 | 4.5 | |
| P4 |
|
4-5 | 5-4 | 3-5 | 5-5 | 3-4 | 2-1 | 3.83 |
| P5 |
|
4-5 | 5-5 | 5-5 | 1-X(confusion) |
|
1-1 | 3.42 |
| P6 |
|
5-4 | 5-3 | 5-5 | 5-5 | 5-5 | 3-4 | 4.17 |
| P7 |
|
5-5 | 5-4 | 5-3 | 5-5 | 2-1 | 4-2 | 3.83 |
| = | = | = | = | = | = | --- | ||
| CMS: | 4.08 | 4.8 | 4.9 | 4.14 | 4.71 | 2.86 | 3.07 |
Jobs to be done
- When I want to organize my resources, I need to be able to create groupings that represent my organization so I can manage permissions effectively.
- When I want to manage a group's membership, I need to have granular access controls for the group members, so I can ensure strict compliance and security protocol enforcement.
- When I want to grant access to resources, I need to be able to give users and groups of users the proper access so that I can enable them to do their work while keeping my intellectual property secure.
Scenarios
Scenario 1
- Prompt - Please build a simple organization using this org chart](https://mermaid-js.github.io/mermaid-live-editor/#/edit/eyJjb2RlIjoiZ3JhcGggVERcbiAgQVtJbmZvcm1hdGlvbiBUZWNobm9sb2d5IGFuZCBEYXRhIEFuYWx5dGljc10gXG4gIEEgLS0-IEVbSVQgRGlnaXRhbCBTZXJ2aWNlc11cbiAgRSAtLT4gRltEaWdpdGFsIFRyYW5zZm9ybWF0aW9uIEVudmlyb25tZW50XVxuICAgIEYgLS0-IE1bUHJvamVjdCBBbHBoYV1cbiAgICBGIC0tPiBOW1Byb2plY3QgQmV0YV1cbiAgICBGIC0tPiBPW1Byb2plY3QgQ29yZV1cbiAgRSAtLT4gR1tBcHBsaWNhdGlvbiBEYXRhYmFzZSBTZXJ2aWNlc11cbiAgRSAtLT4gSFtCdXNpbmVzcyBQcm9jZXNzIE1hbmFnZW1lbnRdXG4gICBIIC0tPiBQW1Byb2plY3QgWmV0YV1cbiAgIEggLS0-IExbUHJvamVjdCBCbGFua10iLCJtZXJtYWlkIjp7InRoZW1lIjoiZGVmYXVsdCJ9LCJ1cGRhdGVFZGl0b3IiOmZhbHNlfQ).
- Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 2
- Prompt - Please add 3 users to the
Application Database Servicesgroup. - Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 3
- Prompt - Please share the
Application Database Servicesgroup toProject CoreandProject Zeta. - Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 4
- Prompt - Create a new top level group for the Product Managers to track their team’s work. Within this new group, create an epic called Increase Revenue.
- Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 5
- Prompt - Setup permissions such that Members of Business Process Management can associate their Issues and Epics to the Increase Revenue Epic in the Product Managers Group.
- Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Scenario 6
- Prompt - Create a user that can assign issues from Project Blank to the epic in Digital Transformation Environment group.
- Average UMUX Lite score for capabilities - {{score}}
- Average UMUX Lite score for ease of use - {{score}}
- How many participants were successful at the task - {{number of successful participants/out of total participants}}
- How many participants failed the task - {{number of participants who failed/out of total participants}}
- Total number of errors each participant encountered while attempting to complete the task/scenario - {{number of errors}}
Participants
Participant 1
- senior software engineer
- Top 3 tasks/responsibilities
- system and application monitoring
- builds monitoring
- QA assistance
- Previous/current GitLab usage: ~3yrs
- Interview
Participant 2
- CTO
- Top 3 tasks/responsibilities
- Fill backlog for devs
- Planning and designing product
- talking to customers to get feedback
- Previous/current GitLab usage: 1.5yr
- Interview
Participant 3
- Senior devops engineer
- Top 3 tasks/responsibilities:
- version control
- running pipelines / writing pipeline code
- kubernetes integration
- Previous/current GitLab usage: 5yrs
- Interview
Participant 4
- IT Support engineer
- Top 3 tasks/responsibilities:
- support end user (trouble shooting hardware/software)
- manage and monitor help desk
- troubleshooting authentication issues
- Previous/current GitLab usage: zero
- Interview
Participant 5
- senior dev ops engineer
- Top 3 tasks/responsibilities
- manage jenkins instances
- build teraform code
- manage teraform code
- Previous/current GitLab usage: ~5yrs
- Interview
Participant 6
- Infrastructure engineer
- Top 3 tasks/responsibilities
- Building and managing infrastructure for dev teams
- monitoring servers
- assisting users with issues
- Previous/current GitLab usage: very little/not often.
- Interview
Edited by Daniel Mora