2023-12-08 Test session report | staging-sanity

Session summary

• Deploy version: 16.7.202312081805-61d43b92dae.aa52277228b
• Deploy environment: gstg-cny
• Pipeline: staging 2615343
• Total 211 tests
• Passed 204 tests
• Failed 1 tests
• 6 other tests (usually skipped)

Failed jobs

• qa-smoke 2/2

Plan

• Total 55 tests
• Passed 55 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue	12163203	passed	-
Plan Issue comments comments on an issue and edits the comment	12163203	passed	-
Plan Epics milestone dates API updates epic dates when adding another issue	12163203	passed	-
Plan Epics milestone dates API updates epic dates when deleting milestones	12163203	passed	-
Plan Epics milestone dates API updates epic dates when removing issue	12163203	passed	-
Plan Issue creation creates an issue	12163199	passed	-
Plan Issue creation closes an issue	12163199	passed	-
Plan Issue creation when using attachments in comments comments on an issue with an attachment	12163199	passed	-
Plan Default issue templates uses default template when creating an issue	12163202	passed	-
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page	12163202	passed	-
Plan Epics roadmap presents epic on roadmap	12163201	passed	-
Plan Project milestone creates a project milestone	12163201	passed	-
Plan Custom issue templates creates an issue via custom template	12163201	passed	-
Plan Read-only board configuration shows board configuration to user without edit permission	12163201	passed	-
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list	12163205	passed	-
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page	12163205	passed	-
Plan Group milestone creates a group milestone	12163205	passed	-
Plan Issue board focus mode focuses on issue board	12163205	passed	-
Plan Custom email customizes email with additional text	12163205 quarantine	passed	-
Plan Milestones Group milestone behaves like when assigned to new issue is assigned	12163205	passed	-
Plan Milestones Group milestone behaves like when assigned to existing issue is assigned	12163205	passed	-
Plan Milestones Project milestone behaves like when assigned to existing issue is assigned	12163205	passed	-
Plan Milestones Project milestone behaves like when assigned to new issue is assigned	12163205	passed	-
Plan Related issues relates and unrelates one issue to/from another	12163206	passed	-
Plan Multiple assignees per issue shows four assignees in the issues list	12163206	passed	-
Plan Group level issues analytics behaves like issues analytics page displays a graph	12163206	passed	-
Plan Project level issues analytics behaves like issues analytics page displays a graph	12163206	passed	-
Plan issue suggestions shows issue suggestions when creating a new issue	12163208	passed	-
Plan Group issue boards creates a group issue board via the GUI	12163208	passed	-
Plan Configurable issue board renames the issue board	12163209	passed	-
Plan Configure issue board by label shows only issues that match the configured label	12163209	passed	-
Plan check xss occurence in @mentions in issues mentions a user in a comment	12163209	passed	-
Plan for group insights page behaves like default insights page displays issues and merge requests dashboards	12163204	passed	-
Plan for project insights page behaves like default insights page displays issues and merge requests dashboards	12163204	passed	-
Plan filter issue comments activities filters comments and activities in an issue	12163204	passed	-
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header	12163204	passed	-
Plan Merge Request Analytics shows merge request analytics chart and stats	12163204	passed	-
Plan mention mentions another user in an issue	12163200	passed	-
Plan Testing project wiki file upload by creating a formatted page with an image uploaded	12163207 quarantine	passed	-
Plan promote issue to epic promotes issue to epic	12163207	passed	-
Plan Contribution Analytics tests contributions	12163207	passed	-
Plan Burndown chart shows burndown chart on milestone page	12163207	passed	-
Plan Epics Management creates an epic	12163207	passed	-
Plan Epics Management creates a confidential epic	12163207	passed	-
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions	12163207	passed	-
Plan Epics Management Resources created via API Visit epic first comments on epic	12163207	passed	-
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic	12163207	passed	-
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic	12163207	passed	-
Plan Value stream analytics without pre-existing dashboard with default template behaves like value stream analytics shows vsa dashboard	12163210	passed	-
Plan Value stream analytics without pre-existing dashboard with custom template behaves like value stream analytics shows vsa dashboard	12163210	passed	-
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it	12163210	passed	-
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it	12163210	passed	-
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it	12163210	passed	-
Plan Issues list successfully exports issues list as CSV	12163210	passed	-
Plan Group issue boards shows multiple group boards in the boards dropdown menu	12163210	passed	-

Create

• Total 57 tests
• Passed 51 tests
• Failed 1 tests
• 5 other tests (usually skipped)

Test	Job	Status	Action
Create Code Suggestions in Web IDE adds text into a file and verifies code suggestions appear	12163200	failed	failure issue

Passed tests:

Test	Job	Status	Action
Create Multiple file snippet creates a project snippet with multiple files	12163203	passed	-
Create Personal snippet creation user creates a personal snippet	12163199	passed	-
Create SSH keys support user can add an SSH key	12163199	passed	-
Create SSH keys support after adding an ssh key can delete an ssh key	12163199	passed	-
Create Git push to canary Gitaly node over HTTP pushes to a project using a canary specific Gitaly repository storage	12163199	passed	-
Create Git push over HTTP user using a personal access token pushes code to the repository	12163199	passed	-
Create Merge request push options sets a target branch	12163202	passed	-
Create Merge request suggestions applies a single suggestion with a custom message	12163202	passed	-
Create new merge request from the event notification after a push via the API creates a merge request	12163202	passed	-
Create new merge request from the event notification after a push via the git CLI creates a merge request	12163202	passed	-
Create Cherry picking from a merge request creates a merge request	12163201	passed	-
Create File management user creates a file via the Web	12163201	passed	-
Create Commit data user views raw commit diff	12163201	passed	-
Create Commit data user views raw email patch	12163201	passed	-
Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different	12163201	passed	-
Create API basics raw file access sets no-cache headers as expected	12163205	passed	-
Create Reverting a commit creates a merge request	12163205	passed	-
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file	12163206	passed	-
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file	12163206	passed	-
Create File management user edits a file via the Web	12163206	passed	-
Create Merge request custom templates creates a merge request via custom template	12163206	passed	-
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push	12163208	passed	-
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes	12163208	passed	-
Create Codeowners displays owners specified in CODEOWNERS file	12163208	passed	-
Create Default merge request templates uses default template when creating a merge request	12163209	passed	-
Create Download merge request patch and diff views the merge request plain diff	12163209	passed	-
Create Download merge request patch and diff views the merge request patches	12163209	passed	-
Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user	12163209	passed	-
Create Repository tags when not protected behaves like successful tag creation can be created by developer_user	12163209	passed	-
Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user	12163209	passed	-
Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user	12163209	passed	-
Create Merge request push options sets labels	12163209	passed	-
Create Merge request push options when labels are set already removes them on subsequent push	12163209	passed	-
Create Merge request batch suggestions applies multiple suggestions	12163209	passed	-
Create Merge request push options sets title and description	12163204	passed	-
Create Merge request push options removes the source branch	12163204	passed	-
Create SSH key support pushes code to the repository via SSH	12163200	passed	-
Create SSH key support pushes multiple branches and tags together	12163200	passed	-
Create Git push over HTTP user pushes code to the repository	12163200	passed	-
Create Git push over HTTP pushes to a project using a specific Praefect repository storage	12163200	passed	-
Create Create a new merge request creates a basic merge request	12163200 quarantine	passed	-
Create Merge request squashing user squashes commits while merging	12163207	passed	-
Create Batch comments in merge request user submits a non-diff review	12163207	passed	-
Create Batch comments in merge request user submits a diff review	12163207	passed	-
Create File Locking locks a file and tries to push as a second user	12163210	passed	-
Create File Locking creates a merge request and fails to merge	12163210	passed	-
Create File Locking checks file locked by other user to be disabled	12163210	passed	-
Create Cherry picking a commit creates a merge request	12163210	passed	-
Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches	12163210	passed	-
Create Git clone over HTTP user performs a deep clone	12163210	passed	-
Create Git clone over HTTP user performs a shallow clone	12163210	passed	-

Other tests:

Test	Job	Status	Action
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown	12163201 quarantine	pending	-
Create Sharing snippets when the snippet is public can be shared with not signed-in users	12163201 quarantine	pending	-
Create Multiple file snippet creates a personal snippet with multiple files	12163209 quarantine	pending	-
Create Multiple file snippet behaves like copying snippet file contents copies a multi-file personal_snippet to a comment and verifies them	12163207 quarantine	pending	-
Create Multiple file snippet behaves like copying snippet file contents copies a multi-file project_snippet to a comment and verifies them	12163207 quarantine	pending	-

Verify

• Total 31 tests
• Passed 31 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Verify Multi-project pipelines creates a multi-project pipeline with artifact download	12163203	passed	-
Verify Runner fleet management shows group runner counts	12163202	passed	-
Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly	12163202	passed	-
Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly	12163202	passed	-
Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly	12163202	passed	-
Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly	12163202	passed	-
Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message	12163202	passed	-
Verify Pipeline with raw variables in YAML expands variables according to expand: true/false	12163202	passed	-
Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value	12163201	passed	-
Verify Run pipeline with manual jobs does not leave any job in skipped state	12163205	passed	-
Verify Include local config file paths with wildcard runs the pipeline with composed config	12163205	passed	-
Verify Include multiple files from multiple projects runs the pipeline with composed config	12163206	passed	-
Verify Include multiple files from a project runs the pipeline with composed config	12163206	passed	-
Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config	12163208	passed	-
Verify Endpoint Coverage spans r/w postgres web sidekiq git api	12163208	passed	-
Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project	12163209	passed	-
Verify Pipelines for merged results and merge trains merges via a merge train	12163209	passed	-
Verify Pipelines for merged results and merge trains creates a pipeline with merged results	12163209	passed	-
Verify Pipeline with protected variable does not expose variable on unprotected branch	12163204	passed	-
Verify Pipeline with protected variable exposes variable on protected branch	12163204	passed	-
Verify Run pipeline with web only rule can trigger pipeline	12163204	passed	-
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails	12163204	passed	-
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes	12163204	passed	-
Verify Pipeline with project file variables can read file variable content with cat	12163207	passed	-
Verify Pipeline with project file variables does not expose file variable content with echo	12163207	passed	-
Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition	12163207	passed	-
Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page	12163210	passed	-
Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined	12163210	passed	-
Verify Parent-child pipelines independent relationship parent pipelines passes if child passes	12163210	passed	-
Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails	12163210	passed	-
Verify Job artifacts are not downloaded when dependencies array is set to empty	12163210	passed	-

Package

• Total 1 tests
• Passed 1 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Package SaaS Container Registry pulls an image from an existing repository	12163199	passed	-

Monitor

• Total 8 tests
• Passed 8 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident	12163203	passed	-
Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident	12163203	passed	-
Monitor Alert settings when using Prometheus integration behaves like sends test alert creates new alert	12163199	passed	-
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert creates new alert	12163199	passed	-
Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert	12163208	passed	-
Monitor Alert settings when using Prometheus integration behaves like sends test alert using authorization key creates new alert	12163200	passed	-
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert using authorization key creates new alert	12163200	passed	-
Monitor Create incident adds linked resources, label, and severity through quick actions	12163207	passed	-

Govern

• Total 35 tests
• Passed 35 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Govern Group Level Scan Execution Policy takes effect when pipeline is run on the main branch	12163203	passed	-
Govern Group Level Scan Execution Policy does not take effect when pipeline is run on non default branch	12163203	passed	-
Govern 2FA allows enforcing 2FA via UI and logging in with 2FA	12163203	passed	-
Govern Policies List page can load Policies page and view the policies list	12163199	passed	-
Govern Policies List page can navigate to Policy Editor page	12163199	passed	-
Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page	12163202	passed	-
Govern project vulnerability report can bulk dismiss vulnerabilities as false positive in vulnerability report	12163202	passed	-
Govern project vulnerability report can successfully bulk change status to confirmed in vulnerability report	12163202	passed	-
Govern Project access tokens can be created and revoked via the UI	12163202	passed	-
Govern Group for add and remove project access behaves like audit event logs audit events for UI operations	12163201	passed	-
Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations	12163201	passed	-
Govern Group for add group behaves like audit event logs audit events for UI operations	12163201	passed	-
Govern Group for change repository size limit behaves like audit event logs audit events for UI operations	12163201	passed	-
Govern Group for update group name behaves like audit event logs audit events for UI operations	12163201	passed	-
Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings	12163205	passed	-
Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy	12163205	passed	-
Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget	12163206	passed	-
Govern Group for change project creation level behaves like audit event logs audit events for UI operations	12163206	passed	-
Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations	12163206	passed	-
Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations	12163206	passed	-
Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations	12163206	passed	-
Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab	12163206	passed	-
Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget	12163206	passed	-
Govern Project for change visibility behaves like audit event logs audit events for UI operations	12163208	passed	-
Govern Project for add user access as guest behaves like audit event logs audit events for UI operations	12163208	passed	-
Govern Project for project archive and unarchive behaves like audit event logs audit events for UI operations	12163208	passed	-
Govern Project for add project behaves like audit event logs audit events for UI operations	12163208	passed	-
Govern Project for add deploy key behaves like audit event logs audit events for UI operations	12163208	passed	-
Govern MR security widget checks that dismissed vulnerabilities do not show up	12163208	passed	-
Govern Security Dashboard in a Project creates an issue from vulnerability details	12163204	passed	-
Govern Security Dashboard in a Project shows vulnerability details	12163204	passed	-
Govern basic user login user logs in using basic credentials and logs out	12163200	passed	-
Govern Security Reports displays security reports in the group security dashboard	12163207	passed	-
Govern Security Reports dependency list has empty state	12163207	passed	-
Govern Project vulnerability report validates "fix a vulnerability" workflow	12163210	passed	-

Data_stores

• Total 23 tests
• Passed 23 tests
• Failed 0 tests
• 0 other tests (usually skipped)

Passed tests:

Test	Job	Status	Action
Data Stores Check for broken images when a new admin logs in behaves like loads all images is expected to have loaded all images	12163203	passed	-
Data Stores Check for broken images when a new user logs in behaves like loads all images is expected to have loaded all images	12163203	passed	-
Data Stores Invite group with a group project behaves like invites group to project grants group and members correct access level	12163203	passed	-
Data Stores Invite group with a personal namespace project behaves like invites group to project grants group and members correct access level	12163203	passed	-
Data Stores User with terminated parent group membership can not edit the project files	12163203	passed	-
Data Stores Project transfer user transfers a project between groups	12163205	passed	-
Data Stores Project activity with git push creates an event in the activity page	12163205	passed	-
Data Stores Project Member adds a project member	12163208	passed	-
Data Stores User when added to parent group is allowed to push code to sub-group project via the CLI	12163208	passed	-
Data Stores User when added to parent group is allowed to create a file in sub-group project via the API	12163208	passed	-
Data Stores User when added to parent group is allowed to commit to sub-group project via the API	12163208	passed	-
Data Stores User when added to sub-group is not allowed to push code to parent group project via the CLI	12163208	passed	-
Data Stores User when added to sub-group is not allowed to commit to parent group project via the API	12163208	passed	-
Data Stores Users API GET /users/:username with a valid username	12163209	passed	-
Data Stores Users API GET /users/:username with an invalid username	12163209	passed	-
Data Stores Users API GET /users	12163209	passed	-
Data Stores Project badge creates project badge	12163209	passed	-
Data Stores Project owner permissions for group projects behaves like adds user as owner has owner role and permissions	12163204	passed	-
Data Stores Project owner permissions for group projects behaves like adds user as maintainer has maintainer role without owner permissions	12163204	passed	-
Data Stores Project owner permissions for personal projects behaves like adds user as owner has owner role and permissions	12163204	passed	-
Data Stores Project owner permissions for personal projects behaves like adds user as maintainer has maintainer role without owner permissions	12163204	passed	-
Data Stores Project in personal namespace behaves like successful project creation creates a new project	12163200	passed	-
Data Stores Project in group behaves like successful project creation creates a new project	12163200	passed	-

Unknown

• Total 1 tests
• Passed 0 tests
• Failed 0 tests
• 1 other tests (usually skipped)

Other tests:

Test	Job	Status	Action
Framework sanity Version check is the specified version	12163200	pending	-

Link to Grafana dashboard for run-type of staging-sanity

• https://dashboards.quality.gitlab.net/d/tR_SmBDVk/main-runs?orgId=1&refresh=1m&var-run_type=staging-sanity

added QA Quality found:staging.gitlab.com triage report labels

added 1 deleted label

closed

added auto closed label