2022-06-15 Test session report | production-sanity

Session summary

  • Deploy version: 15.1.202206151720-02a77a8d934.f09310c656a
  • Deploy environment: gprd-cny
  • Pipeline: production 1261987
  • Total 106 tests
  • Passed 97 tests
  • Failed 2 tests
  • 7 other tests (usually skipped)

Failed jobs

Manage

  • Total 23 tests
  • Passed 22 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Manage Project transfer between groups user transfers a project between groups 7366329 passed -
Manage basic user login user logs in using basic credentials and logs out 7366313 passed -
Manage Project in personal namespace behaves like successful project creation creates a new project 7366313 passed -
Manage Project in group behaves like successful project creation creates a new project 7366313 passed -
Manage project insights page behaves like default insights page displays issues and merge requests dashboards 7366340 passed -
Manage group insights page behaves like default insights page displays issues and merge requests dashboards 7366340 passed -
Manage Add project member user adds project member 7366340 passed -
Manage Project activity user creates an event in the activity page upon Git push 7366326 passed -
Manage Personal project permissions when user is added as Owner has Owner role with Owner permissions 7366346 passed -
Manage Personal project permissions when user is added as Maintainer has Maintainer role without Owner permissions 7366346 passed -
Manage Repository tags when protected behaves like successful tag creation can be created by maintainer_user 7366332 passed -
Manage Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 7366332 passed -
Manage Repository tags when not protected behaves like successful tag creation can be created by developer_user 7366332 passed -
Manage Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 7366332 passed -
Manage Users API GET /users/:username with an invalid username 7366344 passed -
Manage Users API GET /users 7366344 passed -
Manage Users API GET /users/:username with a valid username 7366344 passed -
Manage Create project badge creates project badge successfully 7366344 passed -
Manage Project access token for the same project can be used to create a file via the project API 7366320 passed -
Manage Project access token for the same project can be used to commit via the API 7366320 passed -
Manage Project access token for a different project cannot be used to commit via the API 7366320 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 7366320 passed -
Other tests:
Test Job Status Action
Manage Project access tokens can be created and revoked via the UI 7366340 pending -

Plan

  • Total 44 tests
  • Passed 43 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Plan Group milestone creates a group milestone 7366329 passed -
Plan issue suggestions shows issue suggestions when creating a new issue 7366329 passed -
Plan Burndown chart shows burndown chart on milestone page 7366329 passed -
Plan Issue creation closes an issue 7366313 quarantine passed -
Plan Issue creation creates an issue 7366313 quarantine passed -
Plan Issue creation when using attachments in comments comments on an issue with an attachment 7366313 quarantine passed -
Plan mention mentions another user in an issue 7366313 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 7366324 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 7366324 passed -
Plan Epics milestone dates API updates epic dates when removing issue 7366324 passed -
Plan Epics milestone dates API updates epic dates when adding another issue 7366324 passed -
Plan Epics milestone dates API updates epic dates when deleting milestones 7366324 passed -
Plan Project milestone creates a project milestone 7366324 passed -
Plan Configurable issue board renames the issue board 7366324 passed -
Plan Issues list successfully exports issues list as CSV 7366340 passed -
Plan Epics roadmap presents epic on roadmap 7366340 passed -
Plan Configure issue board by label shows only issues that match the configured label 7366340 passed -
Plan Issue board focus mode focuses on issue board 7366326 passed -
Plan Default issue templates uses default template when creating an issue 7366326 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 7366326 passed -
Plan Multiple assignees per issue shows four assignees in the issues list 7366346 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 7366346 passed -
Plan Related issues relates and unrelates one issue to/from another 7366346 passed -
Plan promote issue to epic promotes issue to epic 7366332 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 7366332 passed -
Plan Read-only board configuration shows board configuration to user without edit permission 7366332 passed -
Plan filter issue comments activities filters comments and activities in an issue 7366332 passed -
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 7366334 passed -
Plan Group level issues analytics behaves like issues analytics page displays a graph 7366334 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 7366334 passed -
Plan Group issue boards creates a group issue board via the GUI 7366334 passed -
Plan Epics Management creates a confidential epic 7366334 passed -
Plan Epics Management creates an epic 7366334 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 7366334 passed -
Plan Epics Management Resources created via API Visit epic first comments on epic 7366334 passed -
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 7366334 passed -
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 7366334 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 7366344 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 7366344 passed -
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 7366344 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 7366344 passed -
Plan Custom issue templates creates an issue via custom template 7366344 passed -
Plan Issue comments comments on an issue and edits the comment 7366320 passed -
Other tests:
Test Job Status Action
Plan Assign Iterations assigns a group iteration to an existing issue 7366340 pending -

Create

  • Total 20 tests
  • Passed 19 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Create Add batch suggestions to a Merge Request applies multiple suggestions 7366329 passed -
Create Reverting a commit creates a merge request 7366329 passed -
Create SSH keys support user can add an SSH key 7366313 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 7366313 passed -
Create Create a new merge request creates a basic merge request 7366313 passed -
Create Multiple file snippet creates a project snippet with multiple files 7366326 passed -
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 7366346 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 7366346 passed -
Create Merge request custom templates creates a merge request via custom template 7366334 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 7366334 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 7366334 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 7366344 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 7366344 passed -
Create File management user edits a file via the Web 7366344 passed -
Create SSH key support pushes multiple branches and tags together 7366316 passed -
Create SSH key support pushes code to the repository via SSH 7366316 passed -
Create Git push over HTTP user using a personal access token pushes code to the repository 7366316 passed -
Create Git push over HTTP user pushes code to the repository 7366316 passed -
Create Multiple file snippet creates a personal snippet with multiple files 7366320 passed -
Other tests:
Test Job Status Action
Create Personal snippet creation user creates a personal snippet 7366316 quarantine pending -

Verify

  • Total 10 tests
  • Passed 8 tests
  • Failed 1 tests
  • 1 other tests (usually skipped)
Test Job Status Action
Verify Pipelines for merged results and merge trains merges via a merge train 7366324 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 7366324 passed -
Verify Run pipeline with web only rule can trigger pipeline 7366324 passed -
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 7366346 passed -
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 7366346 passed -
Verify Pipeline editor when CI has invalid syntax shows invalid validations 7366344 passed -
Verify Pipeline editor when CI has valid syntax shows valid validations 7366344 passed -
Verify Add or Remove CI variable via UI user adds a CI variable 7366316 passed -
Verify Add or Remove CI variable via UI user removes a CI variable 7366316 passed -
Other tests:
Test Job Status Action
Verify Pipeline creation and processing users creates a pipeline which gets processed 7366316 quarantine pending -

Package

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Package Container Registry pushes project image to the container registry and deletes tag 7366326 pending -

Configure

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Configure Kubernetes Agent deploys a K8s manifest file 7366320 pending -

Secure

  • Total 4 tests
  • Passed 3 tests
  • Failed 1 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Secure project vulnerability report can successfully bulk change status in vulnerability report 7366332 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Secure License merge request widget manage licenses from the merge request 7366340 passed -
Secure Security Reports in a Merge Request displays the Security reports in the merge request 7366346 passed -
Secure project vulnerability report can successfully change status of a vulnerability in vulnerability details page 7366332 passed -

Protect

  • Total 2 tests
  • Passed 2 tests
  • Failed 0 tests
  • 0 other tests (usually skipped)
Passed tests:
Test Job Status Action
Protect Policies List page can load Policies page and view the policies list 7366316 passed -
Protect Policies List page can navigate to Policy Editor page 7366316 passed -

Unknown

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Version sanity check is the specified version 7366316 pending -

Link to Grafana dashboard for run-type of production-sanity