#### Context In a first quick usability test around our merge request page, the approval rules stood out as the one aspect where users had the most trouble understanding our UI https://gitlab.com/gitlab-org/gitlab-design/issues/441. #### Research Questions * Do users know where to go to set up Merge Request approval rules? * Are users able to set up multiple approval rules? * Do users understand how the Merge Request approvals feature works? * Is the interface for setting up MR approval rules usable? * Are users able to set up the Vulnerability-Check rule? #### Methodology 5 usability testing sessions with GitLab users who were familiar with the MR approval rules feature (P1, P2, P3) and not familiar with the feature (P4, P5). Familiarity here is mainly based on their responses to the screener survey and whether they had read about or interacted with the feature before. None of the participants use the feature regularly. Tasks include setting up approvals, editing approvals, adding or removing an approval rule, and creating a `Vulnerability-Check`rule. #### Participants | | P1 | P2 | P3 | P4 | P5 | |-------------------------------------|--------------------------------------------------------------------|--------------------------------------------------------------------|--------------------------------------------------------------------|--------------------------------------------------------------------|--------------------------------------------------------------------| | Role | Full-stack Engineer/Developer | CTO/Co-founder | Applied Scientist | Back-end Engineer/Developer | Development Team Lead | | GitLab package | GitLab.com Free | GitLab.com Free, Starter | Ultimate | Core | Core | | Organization size | 11 - 100 people | 11 - 100 people | 1 - 10 people | 1001 - 10,000 people | 11 - 100 people | | Familiarity with MR Approvals rule? | Familiar | Familiar | Familiar | Not very familiar | Not at all familiar | | Years using GitLab | Since 2017 | Since 2017 | Since 2013 | Since 2018 | Since 2015 | | Video URL | https://drive.google.com/open?id=1JwYXLmj86OGkNHEw2mXbzFuToFtEKE4x | https://drive.google.com/open?id=1Yp59Ry2RGqN7qS4r6cRAAZQsP9OustE9 | https://drive.google.com/open?id=1TMREG-3iW7y1k59vPp9BKBsT-6-bk12_ | https://drive.google.com/open?id=1qJU4xe0RQSXMG05a6PqrLexZPTSLxxxW | https://drive.google.com/open?id=14i2C_jeA95Tqr_XYugvoyJi5lZq7_KXl | #### Links - Notes spreadsheet: https://docs.google.com/spreadsheets/d/1VNkCkZZUlmHbQeAnltxA_WvYW0D7t-BulfkWgMWvRIk/edit?usp=sharing - Research issue: https://gitlab.com/gitlab-org/ux-research/issues/270 - UX Scorecard: https://gitlab.com/gitlab-org/gitlab-design/issues/441