Researcher Checklist: Discoverability of Auto DevOps
Research questions
- Do existing users know about Auto DevOps?
- Do existing users know about our Google Kubernetes Engine offer?
- Do existing users know if Auto DevOps is enabled on their project?
- Do existing users know how to enable Auto DevOps?
- Do existing users know how clusters relate to Auto DevOps? (IE. Auto DevOps must be enabled with the Cluster and Cluster is needed for full Auto DevOps experience)
- Do existing users know how to add a cluster after enabling Auto DevOps?
- Do users understand the difference between a (custom) CI path and Auto DevOps?
- Where do users expect to find Auto DevOps settings? How does this relate to the (custom) CI path placement?
- Where do users expect to create a cluster?
Assumptions
- Users are not aware of Auto DevOps within their projects
- Users do not know whether or not Auto DevOps is on/off
- Users do not know why they should use Auto DevOps
- Users do not understand the relationship between enabling Auto DevOps and creating Clusters
- Users do not understand the differences between a CI path and Auto DevOps and how they affect each other
Aim of the research
- Users know the benefits of Auto DevOps and enable it within their projects.
- Users are able to successfully complete the setup process by enabling Auto DevOps and creating a Cluster through GKE (At least understand the need to create a cluster and where/how to do it.
Out of scope
- No need to test the cluster creation process in this series. This testing cycle will focus on discoverability and understanding.
Progress
Script A - Existing Experience
-
Meeting: Finalise script with Taurie [Friday 18th May] -
Schedule 5 users [Deadline: Friday 18th May] -
Write usability testing script [Deadline: Friday 18th May] -
Update testing environment with latest RC [Deadline: Friday 18th May] - Running 10.8.0-rc12 CE -
Conduct one testing session [Deadline: Monday 21st May] -
Edit guide/script if required [Deadline: Monday 21st May] -
Conduct remaining testing sessions [Deadline: Monday 21st May] -
Pay users [Deadline: Monday 21st May] -
Meeting Debrief Taurie on the sessions [Deadline: Monday 21st May] -
Analyse videos [Deadline: Thursday 23rd May] -
Edit videos [Deadline: Thursday 23rd May] -
Write up findings into a report [Deadline: Tuesday 29th May]
Script B - Taurie's prototype
Prototype: https://sketch.cloud/s/Pmab1/all/page-1/dashboard__projects/play
-
Meeting: Prototype check-in meeting with Taurie [Tuesday 15th May] -
Schedule 5 users [Deadline: Friday 18th May] -
Meeting Review finished prototype & discuss script [Deadline: Monday 21st May] -
Write usability testing script [Deadline: Tuesday 22nd May] -
Conduct one testing session [Deadline: Wednesday 23rd May] -
Edit guide/script if required [Deadline: Wednesday 23rd May] -
Conduct remaining testing sessions [Deadline: Wednesday 23rd May] -
Pay users [Deadline: Wednesday 23rd May] -
Analyse videos [Deadline: Thursday 24th May] -
Edit videos [Deadline: Thursday 24th May] -
Meeting: Update Taurie on findings. Decide on next steps. [Thursday 24th May] -
Write up findings into a report [Deadline: Tuesday 29th May]
Results
Videos
Script A
User 1 - https://drive.google.com/file/d/17712l_Phj_3oNbCc3zCEQEBdYGCnHG75/
User 2 - https://drive.google.com/file/d/1nFKK5AJNUDciX3XUQenlR_X26XO5BcLE/
User 3 - https://drive.google.com/file/d/1NnpHVCZtpZR1Ew0bg5SebSYGJ3L4kF9K/
User 4 - https://drive.google.com/file/d/1oBGoYJmdpTO-oh_h65ctJZ_htZ8YJ8pS/
User 5 - https://drive.google.com/file/d/1Hd7ZEISeA_r6x9tSyFqC1YouMNyVW3ND/
User 6 - https://drive.google.com/file/d/1jsjR0DI1InCL4O3rPZeJDFR0C0enQaDM/
Script B
User 7 - https://drive.google.com/file/d/1DwyubiRt50rUGfHLv4D73THvYOhoU4Fl/
User 8 - https://drive.google.com/file/d/1eqN-ul2rPHsHMig4UXMKNBSyHOLW8MBL/
User 9 - https://drive.google.com/file/d/1-at2FCke16lQqliEEKHit0p--PfY63Nr/
User 10 - https://drive.google.com/file/d/1-ulZx8FtYSuCfwp11X1uLT3iNu03ce00/
User 11 - https://drive.google.com/file/d/1PIlatR43_5mY9egbVDnlzNoYK7EQkJ8m/
Report
https://drive.google.com/file/d/1jiDfUSibPh94cDuN4YvvhsCAMR8XGVAf/