2022-06-15 Test session report | canary-sanity

Session summary

  • Deploy version: 15.1.202206151720-02a77a8d934.f09310c656a
  • Deploy environment: gprd-cny
  • Pipeline: canary 1261986
  • Total 118 tests
  • Passed 107 tests
  • Failed 2 tests
  • 9 other tests (usually skipped)

Failed jobs

Manage

  • Total 23 tests
  • Passed 22 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Manage Project transfer between groups user transfers a project between groups 7366322 passed -
Manage Project in personal namespace behaves like successful project creation creates a new project 7366307 passed -
Manage Project in group behaves like successful project creation creates a new project 7366307 passed -
Manage basic user login user logs in using basic credentials and logs out 7366307 passed -
Manage Project access token for the same project can be used to create a file via the project API 7366314 passed -
Manage Project access token for the same project can be used to commit via the API 7366314 passed -
Manage Project access token for a different project cannot be used to commit via the API 7366314 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 7366314 passed -
Manage project insights page behaves like default insights page displays issues and merge requests dashboards 7366335 passed -
Manage group insights page behaves like default insights page displays issues and merge requests dashboards 7366335 passed -
Manage Add project member user adds project member 7366335 passed -
Manage Personal project permissions when user is added as Owner has Owner role with Owner permissions 7366342 passed -
Manage Personal project permissions when user is added as Maintainer has Maintainer role without Owner permissions 7366342 passed -
Manage Project activity user creates an event in the activity page upon Git push 7366319 passed -
Manage Create project badge creates project badge successfully 7366339 passed -
Manage Users API GET /users/:username with an invalid username 7366339 passed -
Manage Users API GET /users/:username with a valid username 7366339 passed -
Manage Users API GET /users 7366339 passed -
Manage Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 7366325 passed -
Manage Repository tags when not protected behaves like successful tag creation can be created by developer_user 7366325 passed -
Manage Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 7366325 passed -
Manage Repository tags when protected behaves like successful tag creation can be created by maintainer_user 7366325 passed -
Other tests:
Test Job Status Action
Manage Project access tokens can be created and revoked via the UI 7366335 pending -

Plan

  • Total 47 tests
  • Passed 46 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Plan Epics milestone dates API updates epic dates when adding another issue 7366317 passed -
Plan Epics milestone dates API updates epic dates when removing issue 7366317 passed -
Plan Epics milestone dates API updates epic dates when deleting milestones 7366317 passed -
Plan Project milestone creates a project milestone 7366317 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 7366317 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 7366317 passed -
Plan Configurable issue board renames the issue board 7366317 passed -
Plan issue suggestions shows issue suggestions when creating a new issue 7366322 passed -
Plan Group milestone creates a group milestone 7366322 passed -
Plan Burndown chart shows burndown chart on milestone page 7366322 passed -
Plan Issue creation closes an issue 7366307 quarantine passed -
Plan Issue creation creates an issue 7366307 quarantine passed -
Plan Issue creation when using attachments in comments comments on an issue with an attachment 7366307 quarantine passed -
Plan mention mentions another user in an issue 7366307 passed -
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 7366331 passed -
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 7366331 passed -
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 7366331 passed -
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 7366328 passed -
Plan Epics Management creates a confidential epic 7366328 passed -
Plan Epics Management creates an epic 7366328 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 7366328 passed -
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 7366328 passed -
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 7366328 passed -
Plan Epics Management Resources created via API Visit epic first comments on epic 7366328 passed -
Plan Group issue boards creates a group issue board via the GUI 7366328 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 7366328 passed -
Plan Group level issues analytics behaves like issues analytics page displays a graph 7366328 passed -
Plan Issue comments comments on an issue and edits the comment 7366314 passed -
Plan Issues list successfully exports issues list as CSV 7366335 passed -
Plan Configure issue board by label shows only issues that match the configured label 7366335 passed -
Plan Epics roadmap presents epic on roadmap 7366335 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 7366342 passed -
Plan Related issues relates and unrelates one issue to/from another 7366342 passed -
Plan Multiple assignees per issue shows four assignees in the issues list 7366342 passed -
Plan Issue board focus mode focuses on issue board 7366319 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 7366319 passed -
Plan Default issue templates uses default template when creating an issue 7366319 passed -
Plan Custom issue templates creates an issue via custom template 7366339 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 7366339 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 7366339 passed -
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 7366339 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 7366339 passed -
Plan Read-only board configuration shows board configuration to user without edit permission 7366325 passed -
Plan promote issue to epic promotes issue to epic 7366325 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 7366325 passed -
Plan filter issue comments activities filters comments and activities in an issue 7366325 passed -
Other tests:
Test Job Status Action
Plan Assign Iterations assigns a group iteration to an existing issue 7366335 pending -

Create

  • Total 24 tests
  • Passed 21 tests
  • Failed 0 tests
  • 3 other tests (usually skipped)
Passed tests:
Test Job Status Action
Create Add batch suggestions to a Merge Request applies multiple suggestions 7366322 passed -
Create Reverting a commit creates a merge request 7366322 passed -
Create Create a new merge request creates a basic merge request 7366307 passed -
Create SSH keys support user can add an SSH key 7366307 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 7366307 passed -
Create Content Editor creates a formatted Wiki page with an image uploaded 7366331 passed -
Create File management user creates a file via the Web 7366331 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 7366328 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 7366328 passed -
Create Merge request custom templates creates a merge request via custom template 7366328 passed -
Create Multiple file snippet creates a personal snippet with multiple files 7366314 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 7366342 passed -
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 7366342 passed -
Create Multiple file snippet creates a project snippet with multiple files 7366319 passed -
Create File management user edits a file via the Web 7366339 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 7366339 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 7366339 passed -
Create Git push over HTTP user using a personal access token pushes code to the repository 7366310 passed -
Create Git push over HTTP user pushes code to the repository 7366310 passed -
Create SSH key support pushes code to the repository via SSH 7366310 passed -
Create SSH key support pushes multiple branches and tags together 7366310 passed -
Other tests:
Test Job Status Action
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 7366331 pending -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 7366331 pending -
Create Personal snippet creation user creates a personal snippet 7366310 quarantine pending -

Verify

  • Total 13 tests
  • Passed 10 tests
  • Failed 2 tests
  • 1 other tests (usually skipped)
Test Job Status Action
Verify Pipeline editor when CI has invalid syntax shows invalid validations 7366339 failed
  • failure issue exists or was created
Verify Pipeline editor when CI has valid syntax shows valid validations 7366339 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 7366317 passed -
Verify Pipelines for merged results and merge trains merges via a merge train 7366317 passed -
Verify Run pipeline with web only rule can trigger pipeline 7366317 passed -
Verify Include local config file paths with wildcard runs the pipeline with composed config 7366331 passed -
Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 7366331 passed -
Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 7366331 passed -
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 7366342 passed -
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 7366342 passed -
Verify Add or Remove CI variable via UI user removes a CI variable 7366310 passed -
Verify Add or Remove CI variable via UI user adds a CI variable 7366310 passed -
Other tests:
Test Job Status Action
Verify Pipeline creation and processing users creates a pipeline which gets processed 7366310 quarantine pending -

Package

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Package Container Registry pushes project image to the container registry and deletes tag 7366319 pending -

Configure

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Configure Kubernetes Agent deploys a K8s manifest file 7366314 pending -

Secure

  • Total 6 tests
  • Passed 6 tests
  • Failed 0 tests
  • 0 other tests (usually skipped)
Passed tests:
Test Job Status Action
Secure Security Reports in a Merge Request can dismiss a vulnerability with a reason 7366331 passed -
Secure Security Reports in a Merge Request can create an issue from a vulnerability 7366331 passed -
Secure License merge request widget manage licenses from the merge request 7366335 passed -
Secure Security Reports in a Merge Request displays the Security reports in the merge request 7366342 passed -
Secure project vulnerability report can successfully change status of a vulnerability in vulnerability details page 7366325 passed -
Secure project vulnerability report can successfully bulk change status in vulnerability report 7366325 passed -

Unknown

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Version sanity check is the specified version 7366310 pending -

Protect

  • Total 2 tests
  • Passed 2 tests
  • Failed 0 tests
  • 0 other tests (usually skipped)
Passed tests:
Test Job Status Action
Protect Policies List page can load Policies page and view the policies list 7366310 passed -
Protect Policies List page can navigate to Policy Editor page 7366310 passed -

Link to Grafana dashboard for run-type of canary-sanity