Category Maturity Scorecard - Verify:Runner Fleet FY23

• 👀 Recruiting issue: https://gitlab.com/gitlab-org/ux-research/-/issues/1977
• 📒 Discussion guide: Google doc
• 🕊 Dovetail project: Private project
• ⬅️ Previous score and scorecard: No previous scorecard.
• ✨ Maturity score: Complete (3.63)
• 🎥 Walkthrough: GitLab Unfiltered Video (Public)
• ⏭ Recommendations: In related issues widget below.

JTBD

When I am managing the execution of many CI jobs, I want an overall understanding of the job execution agents connected to my organization, so I can make effective decisions.

Prep

Set up tasks

Status	Task	DRIs
✅	Add Complete (Nov 2022) and Lovable dates to https://gitlab.com/gitlab-com/www-gitlab-com/blob/master/data/categories.yml (MR)	@DarrenEastman
✅	Choose JTBD and ensure it is validated	@gdoyle @DarrenEastman
✅	Create recruiting issue	@gdoyle
✅	Create screener for recruiting - collaborate with PM in a doc before adding to Qualtrics	@gdoyle @DarrenEastman
✅	Set up Calendly to accept invites	@gdoyle
✅	Add screener to recruiting issue (pass off to research coordinator)	@gdoyle @cfaughnan
✅	Create a dovetail project for CM scorecard sessions and data analysis	@gdoyle
✅	Create a discussion guide for tasks and scenarios	@gdoyle @DarrenEastman
✅	Create a testing environment for participants to use to go through the tasks and scenarios	@gdoyle @DarrenEastman
✅	Run the sessions	@gdoyle @DarrenEastman
✅	Upload sessions to dovetail	@gdoyle
✅	Analyze sessions	@gdoyle
✅	Calculate CM score	@gdoyle
✅	Create Actionable InsightProduct change issues	@gdoyle
✅	Create video walkthrough	@gdoyle

Category Maturity Scorecard Checklist

Learn more about Category Maturity Scorecards

1. Review the Category Maturity Scorecard handbook page and follow the process as described. Reach out to the UX Researcher for your stage if you have questions.
2. Document the research data and insights in a Dovetail project using the Category Maturity Scorecard Dovetail project template.
3. Link the Dovetail project in this issue.
4. Document the results of each JTBD scenario using the Dovetail template.
5. If the participant has not granted permission to share the recording publicly, ensure the sharing settings are set to GitLab-only.
6. If needed, create a recommendation issue for these sessions.
7. Once the research has concluded, update the issue description Outcome section with the maturity level. The outcome can be a downgrade, remain, or increase in x-maturity. For example, The CM Scorecard research has concluded and we have increased the maturity for Dependency Scanning to Complete.

Outcome

The CM scorecard research has concluded and we have evaluated the maturity for Runner Fleet to Complete.