Display security policy violation details to users
<!-- The first section "Release notes" is required if you want to have your release post blog MR auto generated. Currently in BETA, details on the **release post item generator** can be found in the handbook: https://about.gitlab.com/handbook/marketing/blog/release-posts/#release-post-item-generator and this video: https://www.youtube.com/watch?v=rfn9ebgTwKg. The next four sections: "Problem to solve", "Intended users", "User experience goal", and "Proposal", are strongly recommended in your first draft, while the rest of the sections can be filled out during the problem validation or breakdown phase. However, keep in mind that providing complete and relevant information early helps our product team validate the problem and start working on a solution. --> ### Release notes <!-- What is the problem and solution you're proposing? This content sets the overall vision for the feature and serves as the release notes that will populate in various places, including the [release post blog](https://about.gitlab.com/releases/categories/releases/) and [Gitlab project releases](https://gitlab.com/gitlab-org/gitlab/-/releases). " --> ### Problem to solve <!-- What problem do we solve? Try to define the who/what/why of the opportunity as a user story. For example, "As a (who), I want (what), so I can (why/value)." --> As a security or compliance professional (and as a developer), I want to understand which policies were violated in an MR, and what led to the violation. Violations of a policy enforced by a scan result policy result in blocking merge requests and requiring approval from designated approvers. Security and development teams must collaborate when an MR is blocked to remediate issues or determine if there are unrelated issues causing the MR to be blocked. A few scenarios may occur: 1. Vulnerabilities introduced in the MR violate the policy rules, such as a Critical SAST finding violates a policy that blocks MRs when Critical SAST findings are detected. In this case, the MR widget should likely display the offending vulnerability as well, which makes it straightforward enough for the team to identify today. However, other scenarios are not as straightforward. 2. A vulnerability detected by Dependency Scanning may violate a policy. The vulnerability may exist on the default branch and a new CVE has triggered the finding as a new violation. While other efforts will likely address this gap, details about this violation in the MR would give users insight to take action. 3. An error may occur in the configuration, such as a mismatch between the scans between source and target branch, which are required for a valid comparison. 4. Invalid approvers may lead to an MR being blocked, requiring the issue to be addressed before MRs can be merged. While there are details provided in the MR widget for this scenario, we don't consistently provide details about violations more broadly. 5. If a parent/child pipeline is used to execute scans, our approval logic does not properly handle this case. Any known cases that may lead to conflicts or errors can be handled and communicated through this bot comment. 6. Perhaps multiple vulnerabilities that violate policies are detected. Providing a clean/clear list of the offending vulnerabilities will reduce any confusion and prevent users from potentially addressing one vulnerability and rerunning the pipeline to learn it's still blocked. ### Intended users <!-- Who will use this feature? If known, include any of the following: types of users (e.g. Developer), personas, or specific company roles (e.g. Release Manager). It's okay to write "Unknown" and fill this field in later. Personas are described at https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/ 1. [Parker, Product Manager](/handbook/product/personas/#parker-product-manager) 1. [Delaney, Development Team Lead](/handbook/product/personas/#delaney-development-team-lead) 1. [Presley, Product Designer](/handbook/product/personas/#presley-product-designer) 1. [Sasha, Software Developer](/handbook/product/personas/#sasha-software-developer) 1. [Priyanka, Platform Engineer](/handbook/product/personas/#priyanka-platform-engineer) 2. [Janell, Enablement Advocate](/handbook/product/personas/#janell-enablement-advocate) 1. [Sidney, Systems Administrator](/handbook/product/personas/#sidney-systems-administrator) 1. [Rachel, Release Manager](/handbook/product/personas/#rachel-release-manager) 1. [Simone, Software Engineer in Test](/handbook/product/personas/#simone-software-engineer-in-test) 1. [Allison, Application Ops](/handbook/product/personas/#allison-application-ops) 1. [Ingrid, Infrastructure Operator](/handbook/product/personas/#ingrid-infrastructure-operator) 1. [Dakota, Application Development Director](/handbook/product/personas/#dakota-application-development-director) 1. [Amy, Application Security Engineer](/handbook/product/personas/#amy-application-security-engineer) 1. [Isaac, Infrastructure Security Engineer](/handbook/product/personas/#isaac-infrastructure-security-engineer) 1. [Alex, Security Operations Engineer](/handbook/product/personas/#alex-security-operations-engineer) 1. [Cameron, Compliance Manager](/handbook/product/personas/#cameron-compliance-manager) --> ### User experience goal <!-- What is the single user experience workflow this problem addresses? For example, "The user should be able to use the UI/API/.gitlab-ci.yml with GitLab to <perform a specific task>" https://about.gitlab.com/handbook/product/ux/ux-research-training/user-story-mapping/ --> ### Proposal <!-- How are we going to solve the problem? Try to include the user journey! https://about.gitlab.com/handbook/journeys/#user-journey --> #### 1. Create a robust API that we can leverage to handle violation details generically By focusing on the API solution first as an MVC, we can ensure the data we need is captured and we can iterate to identify the ideal UI patterns for displaying the data. A generic solution will allow us to also display the data in other interfaces, such as the WebIDE and VS Code extension. Other teams would also be undeterred in leveraging the API to build this independently. #### 2. Once we have the API, we can work to display this additional content in the bot comment as an MVC step We could display content in the comment to cover Violations and Errors: >>> **Violations** 1. Line 34 -- /Filepath/Filename.md -- Critical SAST Vulnerability 2. Line 325 -- /Filepath/Filename.md -- High Dependency Scanning Vulnerability **Errors** 1. //verbose error message >>> #### 3. Expand to create more custom workflows In future iterations, we could explore new UI interactions for exposing violation data in the MR Widget, MR Details, and as discussed in https://gitlab.com/groups/gitlab-org/-/epics/10975+, in the MR diff view. ### Further details <!-- Include use cases, benefits, goals, or any other details that will help us understand the problem better. --> - In https://gitlab.com/groups/gitlab-org/-/epics/10975+, the epic considers vulnerabilities violating a policy, there are further scenarios not considered. It would only capture a subset of the cases that may cause an MR to be blocked. - This epic will be focused on providing more general violation details and error messaging in the MR, allowing users to troubleshoot and take action to unblock the MR. ### Permissions and Security <!-- What permissions are required to perform the described actions? Are they consistent with the existing permissions as documented for users, groups, and projects as appropriate? Is the proposed behavior consistent between the UI, API, and other access methods (e.g. email replies)? Consider adding checkboxes and expectations of users with certain levels of membership https://docs.gitlab.com/ee/user/permissions.html * [ ] Add expected impact to members with no access (0) * [ ] Add expected impact to Guest (10) members * [ ] Add expected impact to Reporter (20) members * [ ] Add expected impact to Developer (30) members * [ ] Add expected impact to Maintainer (40) members * [ ] Add expected impact to Owner (50) members Please consider performing a threat model for the code changes that are introduced as part of this feature. To get started, refer to our Threat Modeling handbook page https://about.gitlab.com/handbook/security/threat_modeling/#threat-modeling. Don't hesitate to reach out to the Application Security Team (`@joernchen`) to discuss any security concerns. --> ### Documentation <!-- See the Feature Change Documentation Workflow https://docs.gitlab.com/ee/development/documentation/workflow.html#for-a-product-change * Add all known Documentation Requirements in this section. See https://docs.gitlab.com/ee/development/documentation/workflow.html * If this feature requires changing permissions, update the permissions document. See https://docs.gitlab.com/ee/user/permissions.html --> ### Availability & Testing <!-- This section needs to be retained and filled in during the workflow planning breakdown phase of this feature proposal, if not earlier. What risks does this change pose to our availability? How might it affect the quality of the product? What additional test coverage or changes to tests will be needed? Will it require cross-browser testing? Please list the test areas (unit, integration and end-to-end) that needs to be added or updated to ensure that this feature will work as intended. Please use the list below as guidance. * Unit test changes * Integration test changes * End-to-end test change See the Quality Engineering quad planning and test planning processes and reach out to your counterpart Software Engineer in Test for assistance. Quad Planning: https://about.gitlab.com/handbook/engineering/quality/quality-engineering/quad-planning Test Planning: https://about.gitlab.com/handbook/engineering/quality/quality-engineering/test-engineering/#test-planning --> ### Available Tier <!-- This section should be used for setting the appropriate tier that this feature will belong to. Pricing can be found here: https://about.gitlab.com/pricing/ * Free * Premium/Silver * Ultimate/Gold --> ### Feature Usage Metrics <!-- How are you going to track usage of this feature? Think about user behavior and their interaction with the product. What indicates someone is getting value from it? Create tracking issue using the Snowplow event tracking template. See https://gitlab.com/gitlab-org/gitlab/-/blob/master/.gitlab/issue_templates/Snowplow%20event%20tracking.md --> ### What does success look like, and how can we measure that? <!-- Define both the success metrics and acceptance criteria. Note that success metrics indicate the desired business outcomes, while acceptance criteria indicate when the solution is working correctly. If there is no way to measure success, link to an issue that will implement a way to measure this. Create tracking issue using the Snowplow event tracking template. See https://gitlab.com/gitlab-org/gitlab/-/blob/master/.gitlab/issue_templates/Snowplow%20event%20tracking.md --> ### What is the type of buyer? <!-- What is the buyer persona for this feature? See https://about.gitlab.com/handbook/marketing/product-marketing/roles-personas/buyer-persona/ In which enterprise tier should this feature go? See https://about.gitlab.com/handbook/product/pricing/#three-tiers --> ### Is this a cross-stage feature? <!-- Communicate if this change will affect multiple Stage Groups or product areas. We recommend always start with the assumption that a feature request will have an impact into another Group. Loop in the most relevant PM and Product Designer from that Group to provide strategic support to help align the Group's broader plan and vision, as well as to avoid UX and technical debt. https://about.gitlab.com/handbook/product/#cross-stage-features --> ### What is the competitive advantage or differentiation for this feature? ### Links / references <!-- Label reminders - you should have one of each of the following labels. Use the following resources to find the appropriate labels: - Use only one tier label choosing the lowest tier this is intended for - https://gitlab.com/gitlab-org/gitlab/-/labels - https://about.gitlab.com/handbook/product/categories/features/ --> <!-- triage-serverless v3 PLEASE DO NOT REMOVE THIS SECTION --> *This page may contain information related to upcoming products, features and functionality. It is important to note that the information presented is for informational purposes only, so please do not rely on the information for purchasing or planning purposes. Just like with all projects, the items mentioned on the page are subject to change or delay, and the development, release, and timing of any products, features, or functionality remain at the sole discretion of GitLab Inc.* <!-- triage-serverless v3 PLEASE DO NOT REMOVE THIS SECTION -->
epic