Validate positioning of "Model experiments" menu item on the sidebar
Perform First-click testing (https://about.gitlab.com/handbook/product/ux/ux-research/first-click-testing/) to validate positioning of "Model experiments" entry point.
Context
During development the "Model experiments" navigation entry was added to the old sidebar under "Package and registries" and to the new sidebar under "Deploy", but no user research was done wether this makes sense (see #391619 (closed)).
Within #391619 (closed), it was recommended to place Model experiments
under Analyze
as a first entry point before model registry is ready.
Validation
Ran first click test with six users in user testing. They were required to choose Data Scientist/Data Analyst as part of the screener. From the recordings and the user profiles, I do not believe the research candidates had machine learning experience. That said, each of the six users associated finding related parameters, metrics, and artifacts
with Analyze
. They did not verbally associate the task with Model experiments
, although 2 users did try clicking on this option.
Given this is a greenfield area within GitLab, I feel confident that we need a new location in the sidebar to host this content. There is not currently existing workflows or pathways to integrate the experience into. @aregnery and I met about this and we both agree with the conclusion.
Rather than spending more time recruiting data analysts in Respondent, my recommendation would be to move forward with placing Model experiments
under Analyze
. We can always move the location once we learn more from users and/or once the model registry is up.