Smoke Test for Duo Vulnerability Resolution GA

🔥 Smoke Tests 🚒

This a supplement to the UAT > UAT for Vulnerability Resolution in the Merge R... (#500101 - closed). The smoke test here focuses on verifying the functionality of the Duo features. The quality of the AI generated prompts and responses will not be covered here (that's covered in the UAT).

Scenarios

VR Activity Filter

  • A1: Displays for vulnerabilities with resolved with AI
  • A2: Displays tooltip when hovered
  • B1: Displays for vulnerabilities with resolved with AI
  • B2: Activity filter has GitLab Duo filter section
  • B3: "Vulnerability resolution available" filters vulnerability list as expected
  • B4: "Vulnerability resolution unavailable" filters vulnerability list as expected
  • B5: "Vulnerability resolution available" updates vulnerability count as expected
  • B6: "Vulnerability resolution unavailable" updates vulnerability count as expected
  • B7: It is enabled by default

VR in MR

C. VR Badge & Button

  • C1: It displays VR badge in the security widget
  • C2: It display "Resolve with AI" the modal

D: VR Workflow

  • D1: On click, it generates VR comment
  • D2: VR comment is scrolled into and is highlighted
  • D3: On click, it creates a VR generated MR
  • D4: When offline and on click, it displays error
  • D5: It is enabled by default

Setup

  1. Clone the demo repo:
  2. Test in .com
  3. Test in Self Managed

How to Test

Please aim to test in production environment as much as possible.

  1. Create a separate thread for each scenario:

Example:

# A: Title of scenario A1
  1. Respond to that thread with your testing result:
Verified: [ENVIRONMENT] | [LINK, if applicable]

| [YOUR TEST]          | Outcome      |
| ---------------      | -----------  |
| [SCREENSHOT or text] | [SCREENSHOT] |
|                      |              |
  1. For reference, please review:
Edited by Samantha Ming