Skip to content

2022-09-22 Test session report | canary-sanity

Session summary

  • Deploy version: 15.4.202209221221-a57ee858447.eae74bb92ee
  • Deploy environment: gprd-cny
  • Pipeline: canary 1433530
  • Total 124 tests
  • Passed 78 tests
  • Failed 42 tests
  • 4 other tests (usually skipped)

Failed jobs

Manage

  • Total 28 tests
  • Passed 17 tests
  • Failed 11 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Manage Project owner permissions for group projects behaves like when user is added as maintainer has maintainer role without owner permissions 8065829 failed
  • failure issue exists or was created
Manage Project owner permissions for group projects behaves like when user is added as owner has owner role with owner permissions 8065829 failed
Manage Project owner permissions for personal projects behaves like when user is added as maintainer has maintainer role without owner permissions 8065829 failed
Manage Project owner permissions for personal projects behaves like when user is added as owner has owner role with owner permissions 8065829 failed
Manage Project activity user creates an event in the activity page upon Git push 8065832 failed
  • failure issue exists or was created
Manage Project transfer between groups user transfers a project between groups 8065841 failed
  • failure issue exists or was created
Manage Project in group behaves like successful project creation creates a new project 8065813 failed
Manage Project in personal namespace behaves like successful project creation creates a new project 8065813 failed
Manage Project Project archive and unarchive behaves like audit event logs audit events for UI operations 8065826 failed
Manage Project Add deploy key behaves like audit event logs audit events for UI operations 8065826 failed
Manage Project Change visibility behaves like audit event logs audit events for UI operations 8065826 failed
Passed tests:
Test Job Status Action
Manage Create project badge creates project badge successfully 8065843 passed -
Manage Invite group to personal namespace project behaves like invites group to project verifies group is added and members can access project with correct access level 8065843 passed -
Manage Invite group to group project behaves like invites group to project verifies group is added and members can access project with correct access level 8065843 passed -
Manage group insights page behaves like default insights page displays issues and merge requests dashboards 8065835 passed -
Manage project insights page behaves like default insights page displays issues and merge requests dashboards 8065835 passed -
Manage basic user login user logs in using basic credentials and logs out 8065816 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 8065841 passed -
Manage Project access token for a different project cannot be used to commit via the API 8065841 passed -
Manage Project access token for the same project can be used to create a file via the project API 8065841 passed -
Manage Project access token for the same project can be used to commit via the API 8065841 passed -
Manage Users API GET /users/:username with a valid username 8065841 passed -
Manage Users API GET /users/:username with an invalid username 8065841 passed -
Manage Users API GET /users 8065841 passed -
Manage Project Add user access as guest behaves like audit event logs audit events for UI operations 8065826 passed -
Manage Project Add project behaves like audit event logs audit events for UI operations 8065826 passed -
Manage Project access tokens can be created and revoked via the UI 8065823 passed -
Manage Add project member user adds project member 8065823 passed -

Plan

  • Total 46 tests
  • Passed 27 tests
  • Failed 19 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Plan Group milestone creates a group milestone 8065843 failed
  • failure issue exists or was created
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 8065835 failed
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 8065835 failed
Plan Epics Management Resources created via API Visit epic first comments on epic 8065835 failed
Plan Issue creation creates an issue 8065816 failed
Plan Issue creation closes an issue 8065816 failed
Plan Issue creation when using attachments in comments comments on an issue with an attachment 8065816 failed
Plan Multiple assignees per issue shows four assignees in the issues list 8065829 failed
  • failure issue exists or was created
Plan Group level issues analytics behaves like issues analytics page displays a graph 8065832 failed
  • failure issue exists or was created
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 8065838 failed
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 8065838 failed
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 8065838 failed
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 8065841 failed
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 8065841 failed
Plan mention mentions another user in an issue 8065813 failed
Plan Group issue boards creates a group issue board via the GUI 8065823 failed
  • failure issue exists or was created
Plan Issues list successfully exports issues list as CSV 8065823 failed
  • failure issue exists or was created
Plan promote issue to epic promotes issue to epic 8065847 failed
Plan Read-only board configuration shows board configuration to user without edit permission 8065847 failed
Passed tests:
Test Job Status Action
Plan Issue comments comments on an issue and edits the comment 8065843 passed -
Plan Default issue templates uses default template when creating an issue 8065835 passed -
Plan Epics Management creates a confidential epic 8065835 passed -
Plan Epics Management creates an epic 8065835 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 8065835 passed -
Plan issue suggestions shows issue suggestions when creating a new issue 8065835 passed -
Plan Epics milestone dates API updates epic dates when deleting milestones 8065835 passed -
Plan Epics milestone dates API updates epic dates when removing issue 8065835 passed -
Plan Epics milestone dates API updates epic dates when adding another issue 8065835 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 8065835 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 8065829 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 8065829 passed -
Plan Related issues relates and unrelates one issue to/from another 8065829 passed -
Plan Configure issue board by label shows only issues that match the configured label 8065829 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 8065832 passed -
Plan Burndown chart shows burndown chart on milestone page 8065838 passed -
Plan filter issue comments activities filters comments and activities in an issue 8065838 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 8065841 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 8065841 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 8065841 passed -
Plan Custom issue templates creates an issue via custom template 8065841 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 8065826 passed -
Plan Issue board focus mode focuses on issue board 8065826 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 8065826 passed -
Plan Epics roadmap presents epic on roadmap 8065823 passed -
Plan Configurable issue board renames the issue board 8065847 passed -
Plan Project milestone creates a project milestone 8065847 passed -

Create

  • Total 30 tests
  • Passed 22 tests
  • Failed 8 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 8065843 failed
  • failure issue exists or was created
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 8065843 failed
  • failure issue exists or was created
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 8065829 failed
  • failure issue exists or was created
Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 8065832 failed
  • failure issue exists or was created
Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 8065832 failed
  • failure issue exists or was created
Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 8065832 failed
  • failure issue exists or was created
Create File management user edits a file via the Web 8065832 failed
  • failure issue exists or was created
Create Add batch suggestions to a Merge Request applies multiple suggestions 8065847 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Create Content Editor creates a formatted Wiki page with an image uploaded 8065843 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 8065843 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 8065843 passed -
Create Repository License Detection on a project with a less commonly used LICENSE behaves like project license detection displays the name of the license on the repository 8065835 passed -
Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository 8065835 passed -
Create Git push over HTTP user pushes code to the repository 8065816 passed -
Create SSH key support pushes code to the repository via SSH 8065816 passed -
Create SSH key support pushes multiple branches and tags together 8065816 passed -
Create Create a new merge request creates a basic merge request 8065816 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 8065829 passed -
Create Merge request custom templates creates a merge request via custom template 8065832 passed -
Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 8065832 passed -
Create Reverting a commit creates a merge request 8065838 passed -
Create File management user creates a file via the Web 8065838 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 8065841 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 8065841 passed -
Create SSH keys support user can add an SSH key 8065813 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 8065813 passed -
Create Git push over HTTP user using a personal access token pushes code to the repository 8065813 passed -
Create Personal snippet creation user creates a personal snippet 8065813 passed -
Create Multiple file snippet creates a personal snippet with multiple files 8065826 passed -
Create Multiple file snippet creates a project snippet with multiple files 8065826 passed -

Verify

  • Total 13 tests
  • Passed 9 tests
  • Failed 3 tests
  • 1 other tests (usually skipped)
Test Job Status Action
Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 8065832 failed
  • failure issue exists or was created
Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 8065832 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 8065847 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Pipeline editor when CI has invalid syntax shows invalid validations 8065835 passed -
Verify Pipeline editor when CI has valid syntax shows valid validations 8065835 passed -
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 8065838 passed -
Verify Pipelines for merged results and merge trains merges via a merge train 8065838 passed -
Verify Run pipeline with web only rule can trigger pipeline 8065838 passed -
Verify Add or Remove CI variable via UI user removes a CI variable 8065813 passed -
Verify Add or Remove CI variable via UI user adds a CI variable 8065813 passed -
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 8065847 passed -
Verify Include local config file paths with wildcard runs the pipeline with composed config 8065847 passed -
Other tests:
Test Job Status Action
Verify Pipeline creation and processing users creates a pipeline which gets processed 8065813 quarantine pending -

Package

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Package Container Registry pushes, pulls image to the registry and deletes tag 8065823 pending -

Configure

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Configure Kubernetes Agent deploys a K8s manifest file 8065820 pending -

Secure

  • Total 2 tests
  • Passed 1 tests
  • Failed 1 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Secure project vulnerability report can successfully change status of a vulnerability in vulnerability details page 8065841 failed
Passed tests:
Test Job Status Action
Secure project vulnerability report can successfully bulk change status in vulnerability report 8065841 passed -

Unknown

  • Total 1 tests
  • Passed 0 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Other tests:
Test Job Status Action
Version sanity check is the specified version 8065816 pending -

Protect

  • Total 2 tests
  • Passed 2 tests
  • Failed 0 tests
  • 0 other tests (usually skipped)
Passed tests:
Test Job Status Action
Protect Policies List page can navigate to Policy Editor page 8065816 passed -
Protect Policies List page can load Policies page and view the policies list 8065816 passed -

Link to Grafana dashboard for run-type of canary-sanity