Category Maturity Scorecard - Verify:Runner Fleet
- Recruiting issue: https://gitlab.com/gitlab-org/ux-research/-/issues/1977
- Discussion guide: Google doc
- Dovetail project: https://dovetailapp.com/projects/1O50nzbal9KVDLsIpFCyb7/readme
- Previous score and scorecard: {{if applicable, add CM Scorecard score and link to scorecard issue}}
- Walkthrough: {{add link to YouTube video or walkthrough document}}
- Recommendations: {{add link to your recommendation issue/s}}
JTBD
When I am managing the execution of many CI jobs, I want an overall understanding of the job execution agents connected to my organization, so I can make effective decisions.
Set up tasks
| Status | Task | DRIs |
|---|---|---|
Add Complete (Nov 2022) and Lovable dates to https://gitlab.com/gitlab-com/www-gitlab-com/blob/master/data/categories.yml (MR) |
@DarrenEastman |
|
| Choose JTBD and ensure it is validated |
@gdoyle @DarrenEastman
|
|
| Create recruiting issue | @gdoyle |
|
| Create screener for recruiting - collaborate with PM in a doc before adding to Qualtrics |
@gdoyle @DarrenEastman
|
|
| Set up Calendly to accept invites | @gdoyle |
|
| Add screener to recruiting issue (pass off to research coordinator) |
@gdoyle @cfaughnan
|
|
| Create a dovetail project for CM scorecard sessions and data analysis | @gdoyle |
|
| Create a discussion guide for tasks and scenarios |
@gdoyle @DarrenEastman
|
|
| Create a testing environment for participants to use to go through the tasks and scenarios |
@gdoyle @DarrenEastman
|
|
| Run the sessions |
@gdoyle @DarrenEastman
|
|
| Upload sessions to dovetail | @gdoyle |
|
| Analyze sessions | @gdoyle |
|
| Calculate CM score | @gdoyle |
|
| Create Actionable InsightProduct change issues (if applicable) | @gdoyle |
Category Maturity Scorecard Checklist
Learn more about Category Maturity Scorecards
-
Review the Category Maturity Scorecard handbook page and follow the process as described. Reach out to the UX Researcher for your stage if you have questions. -
Document the research data and insights in a Dovetail project using the Category Maturity Scorecard Dovetail project template. -
Link the Dovetail project in this issue. -
Document the results of each JTBD scenario using the Dovetail template. -
If the participant has not granted permission to share the recording publicly, ensure the sharing settings are set to GitLab-only. -
If needed, create a recommendation issue for these sessions. -
Once the research has concluded, update the issue description Outcomesection with the maturity level. The outcome can be a downgrade, remain, or increase in x-maturity. For example,The CM Scorecard research has concluded and we have increased the maturity for Dependency Scanning to Complete.
Outcome
Other notes
{{Add any additional notes that came from freeform discussion or elsewhere}}