Skip to content

Solution Validation: Vulnerability groups and customizable saved views on the Vulnerability Report

What did we learn?

Results
We learned that filtering and search are the most important and most valuable features to Security Engineers, over grouping and custom views. We also got constructive feedback on the design prototypes shared which I'll be incorporating into follow-up design iterations of each feature. The next step is to do follow-up solution validation research on designs for filtering in #1904 (closed). Afterward, we'll incorporate grouping functionality into the design (which was solution validated as part of this study), and finally, conduct another round of solution validation on a more fully fleshed-out design prototype for custom views.
https://dovetailapp.com/projects/T0M0OrFCUjhxzoBFPLiMh/v/4FXR1mxEkUZ7fq7Tj1nxaU/present

Usefulness rating average by feature (out of 7):

  • Improved filtering & search: 6.25
  • Vulnerability groups: 5.4
  • Customizable saved views: 4.6

Watch the research insights walkthrough video (16 minutes at normal speed, but you can also toggle on "Only play highlights" which reduces it to 10 minutes at normal speed). You can also take a self-guided tour through the Dovetail insights.

Research planning

What’s this issue all about?

To conduct solution validation (and a sprinkle of problem validation) on the designs for vulnerability groups and customizable saved views on the Vulnerability Report.

Participant list, script, and notes: https://docs.google.com/spreadsheets/d/1fywqCbw6VFJRsMQUpc9RWTfur4mL6xLyN7fD9R3cWjY/edit?usp=sharing

Who is the target user of the feature?

Sam, Security Analyst

Participant profile

5+ GitLab security engineers and customers who use the Vulnerability Report

What questions are you trying to answer?

  • What current pain points do they have with the vulnerability management tasks in the Vulnerability Report?

  • Do vulnerability groups and/or customized views solve any of those problems?

  • If not, what solutions would solve those problems?

Additional questions

On a scale of 1-7, how useful are these features for you?

What hypotheses and/or assumptions do you have?

  • Both grouping and customizable views will be useful to participants; custom tab creation more so than grouping per the Kano analysis results

  • The design prototypes will validate that the designs are on the right path (although follow-up task-based solution validation will be needed to confirm that users can complete the tasks using the design proposal)

What decisions will you make based on the research findings?

  • Feature prioritization on the roadmap
  • Design iterations

What's the latest milestone that the research will still be useful to you?

n/a

Edited by Becka Lippert