Icon Redesign (Issue/Epic), Study 2 - Usability Testing of Proposed Icons
What’s this issue all about?
The research conducted in #144 (closed) showed that the majority of respondents viewed an
issue + checkmark
icon as best representing a closed issue. The checkmark is viewed as communicating that the issue is approved, completed, or resolved...If we change the current "closed" issue icon toissue + checkmark
, do the other issue/epic/MR state icons need to change as well?
Objective
Investigate whether users understand what the final proposed icons from #322 (closed) mean in context. Testing the 12px size, in order to determine whether they are recognizable.
Additional considerations
- Is the connection made between the normal-sized “parent” icon and the smaller “status” version?
- Do the smaller icons perform better as status in the list? Wondering this because to a degree the larger icons can create some scanning fatigue (at least for me) where they start to look less like inline status, and more like visual anchors. I think they should feel more inline and additive than stopping points that inhibit scanning.
- Are the small icons clear enough?
Methodology
Design evaluation via UsabilityHub. Testing in the context of the wider UI (so you can investigate the concerns re: todos in the global nav). Testing with both GitLab users and people unfamiliar with GitLab.
- After the testing, follow up with attractiveness/preference questions (scoring the icons, picking best/least favourite icon from the direction set and then showing them the existing icon set and asking which they prefer and why).
existing GitLab users will naturally be quicker to perform tasks on the existing experience/icon set. Therefore, to mitigate this, you might want to consider using non-GitLab users for Study 2 and 3 in order to aid comparison. (https://gitlab.com/gitlab-org/ux-research/issues/164#note_198954521)
What decisions will you make based on the research findings?
This will gather data on the usability of the proposed icons and serve as a comparison against the current icon set.
What is the study called in Qualtrics?
Issue/Epics Icons, Study 2
Progress
-
Create a design evaluation study in Qualtrics [Deadline: Fri Nov 1st] -
Preview/test study to double-check flow [Deadline: Fri Nov 1st]
-
-
Send study to non-GitLab users in GitLab First Look [(Target) Deadline: Mon Nov 4th] -
Send study out via Qualtrics panel? Share in social media circles [Deadline: Tues Nov 5th]
-
-
Review results and share! [Deadline: Fri Nov 8th]
Conclusion
Out of context, these icons received feedback similar to the larger D1 icons. From these results, I don't anticipate the difference in size causing an inability to understand the icons.
I do feel some concern for the Epics icon due to the similarity in appearance with shields and badges. The Epic icons are still being associated with security and protection most commonly.
However, as we concluded in #322 (closed), the checkmark does still indicate success or completion, so the meaning of the state should come through to users when they're on the Epic page and they likely can build an association over time. Perhaps the risk of confusion will be lower since the Security & Compliance icon was updated as well.
- Results: &2178 (closed)
- Additonal feedback: #323 (comment 243110952)