Researcher Checklist: Research into CI/CD adoption
Aim of the research
Gain a richer understanding of how to advocate our CI capabilities among existing customers. Understand what attracts GitLab users to the CI/CD tools they use, what prevents them from using GitLab CI, what users like about GitLab CI, and what users would like to improve about GitLab CI.
Research questions
For GitLab users who are not using GitLab CI:
- What is preventing existing GitLab customers from adopting GitLab CI?
- What other tools are these customers using for CI?
- How does GitLab CI compare to these tools?
- What are customers looking for in a CI solution?
For GitLab users who are using GitLab CI:
- How did they hear about GitLab CI?
- What attracted them to GitLab CI?
- What do they like about GitLab CI?
- What do they dislike about GitLab CI?
- Are they using any other tools for CI/CD?
Assumptions
- Existing GitLab customers may not be using GitLab CI due to the following factors:
- Lack of awareness of the existence of our CI features
- Reluctance to change existing CI solution due to time invested in setting up, customizing, and adding plugins
- Satisfied with "good enough" CI / more urgent issues to work on
- Missing capabilities
Methodology
- User interviews with GitLab users who are and are not using CI/CD. Survey sent out to GitLab users.
Progress
Interviews
-
Write interview guide [Deadline: Fri May 11th] -
Write screener survey [Deadline: Tues May 15th] -
Send screener survey to 6 groups (1Y-6Y) of the research panel [Deadline: Weds May 16th] -
Review screener survey results [Deadline: Fri May 18th] * [x] If 5-10 GitLab users who are not using CI/CD have not been found, send screener survey to 2 more groups (7Y, 8Y). -
Schedule 5 participants [Deadline: Mon May 21st] -
Conduct interviews [Proposed Dates: Weds May 23rd / Thurs May 24 / Weds May 30] -
Pay participants [Deadline: Weds May 30th] -
Edit videos [Deadline: Weds May 30th] -
Write up findings into a report [Deadline: Weds June 6th] -
Add the report to the UX Research Wiki [Deadline: Fri June 8th] -
Update relevant issues in the CE project [Deadline: Fri June 8th]
Survey
-
Write survey [Deadline: Fri May 25th] -
Send survey to 2 groups (9Y/10Y) of research panel [Deadline: Mon May 28th] -
Check responses to survey and send to groups 11Y-18Y of research panel [Deadline: Tues May 29th] -
Close survey [Deadline: Mon June 4th] -
Conduct prize draw, purchase Amazon vouchers, and contact winners [Deadline: Mon June 4th] -
Cleanse data [Deadline: Weds June 6th] -
Analyze data [Deadline: Thurs June 7th] -
Write findings into a report [Deadline: Fri June 8th] -
Add the report to the UX Research Archive [Deadline: Fri June 8th] -
Update relevant issues in the CE project [Deadline: Fri June 8th]
Results
User Interviews
Using GitLab CI
- User 1 - https://drive.google.com/file/d/1DniLVEr7N0_canRsgBXWDD6tX_JA2rk1/view?usp=sharing
- User 2 - Did not want recording to be shared on GitLab.
- User 3 - https://drive.google.com/file/d/1Gizt_jCDRYj6qb6kQL0pvaaCA2IRoYzE/view?usp=sharing
- User 4 - https://drive.google.com/file/d/1iKrzVTXYrbYDMrTAtXZj0AflhMwogiAI/view?usp=sharing
- User 5 - https://drive.google.com/file/d/1PMePOscckKHui_ex8yvwspKHEqUSMncc/view?usp=sharing
Not Using GitLab CI
-
User 6 - https://drive.google.com/file/d/13gLehfcJ1sqxBHf6_Mb4RC-c5DmrX3Jt/view?usp=sharing
-
User 7 - https://drive.google.com/file/d/1Bi7TS6sYOg13lTvKriZLbtlp8qVFJdv3/view?usp=sharing
Survey
- 40 respondents
- Emailed to segments of GitLab Research Panel.
- Survey report
Edited by Katherine Okpara