Skip to content

2022-09-22 Test session report | canary-full

Session summary

  • Deploy version: 15.4.202209221221-a57ee858447.eae74bb92ee
  • Deploy environment: gprd-cny
  • Pipeline: canary 1433529
  • Total 362 tests
  • Passed 213 tests
  • Failed 118 tests
  • 31 other tests (usually skipped)

Failed jobs

Manage

  • Total 43 tests
  • Passed 28 tests
  • Failed 14 tests
  • 1 other tests (usually skipped)
Test Job Status Action
Manage prevent forking outside group when enabled does not allow forking outside of group 8065825 failed
  • failure issue exists or was created
Manage prevent forking outside group when disabled allows forking outside of group 8065825 failed
  • failure issue exists or was created
Manage Group Add and remove project access behaves like audit event logs audit events for UI operations 8065825 failed
  • failure issue exists or was created
Manage Group Update group name behaves like audit event logs audit events for UI operations 8065825 failed
  • failure issue exists or was created
Manage Group Add user, change access level, remove user behaves like audit event logs audit events for UI operations 8065825 failed
  • failure issue exists or was created
Manage Group Add group behaves like audit event logs audit events for UI operations 8065825 failed
  • failure issue exists or was created
Manage Group with members can be shared with another group with correct access level 8065825 failed
  • failure issue exists or was created
Manage project insights page behaves like default insights page displays issues and merge requests dashboards 8065825 failed
  • failure issue exists or was created
Manage Project activity user creates an event in the activity page upon Git push 8065822 failed
Manage Group access tokens can be created and revoked via the UI 8065822 failed
  • failure issue exists or was created
Manage basic user login user logs in using basic credentials and logs out 8065822 failed
  • failure issue exists or was created
Manage Users API GET /users 8065812 failed
  • failure issue exists or was created
Manage Users API GET /users/:username with an invalid username 8065812 failed
  • failure issue exists or was created
Manage Users API GET /users/:username with a valid username 8065812 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Manage group insights page behaves like default insights page displays issues and merge requests dashboards 8065825 passed -
Manage Group Enable and disable allow user request access behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Group Disable and Enable LFS behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Group Change project creation level behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Group Enable and disable membership lock behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Project Change visibility behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Project Add deploy key behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Project Add user access as guest behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Project Add project behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Project Project archive and unarchive behaves like audit event logs audit events for UI operations 8065825 passed -
Manage Invite group to personal namespace project behaves like invites group to project verifies group is added and members can access project with correct access level 8065822 passed -
Manage Invite group to group project behaves like invites group to project verifies group is added and members can access project with correct access level 8065822 passed -
Manage Add project member user adds project member 8065822 passed -
Manage Project in personal namespace behaves like successful project creation creates a new project 8065822 passed -
Manage Project in group behaves like successful project creation creates a new project 8065822 passed -
Manage Create project badge creates project badge successfully 8065822 passed -
Manage Project access tokens can be created and revoked via the UI 8065822 passed -
Manage Project owner permissions for personal projects behaves like when user is added as maintainer has maintainer role without owner permissions 8065822 passed -
Manage Project owner permissions for personal projects behaves like when user is added as owner has owner role with owner permissions 8065822 passed -
Manage Project owner permissions for group projects behaves like when user is added as maintainer has maintainer role without owner permissions 8065822 passed -
Manage Project owner permissions for group projects behaves like when user is added as owner has owner role with owner permissions 8065822 passed -
Manage Project transfer between groups user transfers a project between groups 8065822 passed -
Manage Project access token for a different project cannot be used to commit via the API 8065812 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 8065812 passed -
Manage Project access token for the same project can be used to create a file via the project API 8065812 passed -
Manage Project access token for the same project can be used to commit via the API 8065812 passed -
Manage Group access token can be used to commit via the API 8065812 passed -
Manage Group access token can be used to create a file via the project API 8065812 passed -
Other tests:
Test Job Status Action
Manage basic user remains logged in when redirected from canary to non-canary node 8065822 quarantine pending -

Plan

  • Total 55 tests
  • Passed 46 tests
  • Failed 7 tests
  • 2 other tests (usually skipped)
Test Job Status Action
Plan Issue closes via pushing a commit 8065812 failed
  • failure issue exists or was created
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 8065830 failed
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 8065830 failed
Plan Group issue boards creates a group issue board via the GUI 8065830 failed
  • failure issue exists or was created
Plan mention mentions another user in an issue 8065827 failed
Plan filter issue comments activities filters comments and activities in an issue 8065827 failed
  • failure issue exists or was created
Plan Issue comments comments on an issue and edits the comment 8065827 failed
Passed tests:
Test Job Status Action
Plan Epics milestone dates API updates epic dates when deleting milestones 8065817 passed -
Plan Epics milestone dates API updates epic dates when updating milestones 8065817 passed -
Plan Epics milestone dates API updates epic dates when adding another issue 8065817 passed -
Plan Epics milestone dates API updates epic dates when removing issue 8065817 passed -
Plan Epics Management creates a confidential epic 8065830 passed -
Plan Epics Management creates an epic 8065830 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 8065830 passed -
Plan Epics Management Resources created via API Visit epic first comments on epic 8065830 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 8065830 passed -
Plan Configure issue board by label shows only issues that match the configured label 8065830 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 8065830 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 8065830 passed -
Plan Default issue templates uses default template when creating an issue 8065830 passed -
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 8065830 passed -
Plan Group level issues analytics behaves like issues analytics page displays a graph 8065830 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 8065830 passed -
Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels 8065830 passed -
Plan Burndown chart shows burndown chart on milestone page 8065830 passed -
Plan promote issue to epic promotes issue to epic 8065830 passed -
Plan Epics roadmap presents epic on roadmap 8065830 passed -
Plan Configurable issue board renames the issue board 8065830 passed -
Plan Multiple assignees per issue shows four assignees in the issues list 8065830 passed -
Plan Read-only board configuration shows board configuration to user without edit permission 8065830 passed -
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 8065830 passed -
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 8065830 passed -
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 8065830 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 8065830 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 8065827 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 8065827 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 8065827 passed -
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 8065827 passed -
Plan Project milestone creates a project milestone 8065827 passed -
Plan Design Management user archives a design 8065827 quarantine passed -
Plan Issue board focus mode focuses on issue board 8065827 passed -
Plan Design Management user adds a design and annotates it 8065827 quarantine passed -
Plan Issue creation creates an issue 8065827 passed -
Plan Issue creation closes an issue 8065827 passed -
Plan Issue creation when using attachments in comments comments on an issue with an attachment 8065827 passed -
Plan Assignees update without refresh 8065827 passed -
Plan Related issues relates and unrelates one issue to/from another 8065827 passed -
Plan Design Management user adds a design and modifies it 8065827 quarantine passed -
Plan issue suggestions shows issue suggestions when creating a new issue 8065827 passed -
Plan Custom issue templates creates an issue via custom template 8065827 passed -
Plan Issues list successfully exports issues list as CSV 8065827 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 8065827 passed -
Plan Group milestone creates a group milestone 8065827 passed -
Other tests:
Test Job Status Action
Plan Group Iterations creates a group iteration automatically through an iteration cadence 8065830 pending -
Plan Assign Iterations assigns a group iteration to an existing issue 8065830 pending -

Create

  • Total 142 tests
  • Passed 108 tests
  • Failed 28 tests
  • 6 other tests (usually skipped)
Test Job Status Action
Create Link to line in Web IDE can link to a specific line of code in Web IDE 8065836 failed
  • failure issue exists or was created
Create Cherry picking a commit creates a merge request 8065836 failed
  • failure issue exists or was created
Create Git push over HTTP user using a personal access token pushes code to the repository 8065836 failed
  • failure issue exists or was created
Create Merge request push options sets title and description 8065812 failed
  • failure issue exists or was created
Create Merge request push options merges when pipeline succeeds 8065812 failed
  • failure issue exists or was created
Create Merge request push options sets merge when pipeline succeeds 8065812 failed
  • failure issue exists or was created
Create Merge request push options sets a target branch 8065812 failed
  • failure issue exists or was created
Create PostReceive idempotent pushes and creates a single push event three times 8065812 failed
  • failure issue exists or was created
Create API basics user creates a project with a file and deletes them afterwards 8065812 failed
  • failure issue exists or was created
Create API basics raw file access sets no-cache headers as expected 8065812 failed
  • failure issue exists or was created
Create Merge request push options sets labels 8065812 failed
  • failure issue exists or was created
Create Merge request push options when labels are set already removes them on subsequent push 8065812 failed
  • failure issue exists or was created
Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different 8065812 failed
  • failure issue exists or was created
Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository 8065842 quarantine failed
  • failure issue exists or was created
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 8065842 failed
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 8065842 failed
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 8065842 failed
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 8065842 failed
Create First file using Web IDE creates the first file in an empty project via Web IDE 8065834 failed
  • failure issue exists or was created
Create Project snippet creation user creates a project snippet 8065834 failed
  • failure issue exists or was created
Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository 8065834 failed
  • failure issue exists or was created
Create Repository License Detection on a project with a less commonly used LICENSE behaves like project license detection displays the name of the license on the repository 8065834 failed
  • failure issue exists or was created
Create SSH key support pushes code to the repository via SSH 8065834 failed
  • failure issue exists or was created
Create SSH key support pushes multiple branches and tags together 8065834 failed
  • failure issue exists or was created
Create Add a directory in Web IDE when user adds a new empty directory shows in the tree view but cannot be committed 8065834 failed
  • failure issue exists or was created
Create File templates user adds .gitlab-ci.yml via file template Julia 8065839 failed
  • failure issue exists or was created
Create File templates user adds .gitignore via file template Android 8065839 failed
Create Multiple file snippet creates a project snippet with multiple files 8065839 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Create Open Web IDE from Diff Tab opens and edits a multi-file merge request in Web IDE from Diff Tab 8065836 passed -
Create Wiki Page deletion has removed the deleted page correctly 8065836 passed -
Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly 8065836 passed -
Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository 8065836 quarantine passed -
Create Merge request custom templates creates a merge request via custom template 8065836 passed -
Create Git clone over HTTP user performs a shallow clone 8065836 passed -
Create Git clone over HTTP user performs a deep clone 8065836 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI 8065836 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI 8065836 passed -
Create Wiki Page List has all expected links that work 8065836 passed -
Create Wiki Sidebar has all expected links that work 8065836 passed -
Create Upload a file in Web IDE when the file is binary shows a Download button 8065836 passed -
Create Upload a file in Web IDE when the file is an image shows an image viewer 8065836 passed -
Create Upload a file in Web IDE when the file is a text file shows the Edit tab with the text 8065836 passed -
Create Upload a file in Web IDE when a file with the same name already exists throws an error 8065836 passed -
Create Review a merge request in Web IDE opens and edits a merge request in Web IDE 8065836 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet 8065836 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet 8065836 passed -
Create Git push over HTTP user pushes code to the repository 8065836 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI 8065836 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI 8065836 passed -
Create Download merge request patch and diff views the merge request plain diff 8065836 passed -
Create Download merge request patch and diff views the merge request email patches 8065836 passed -
Create Wiki testing wiki content manipulation inside a project by manipulating content on the page using git push 8065836 passed -
Create Wiki testing wiki content manipulation inside a project by manipulating content on the page 8065836 passed -
Create Create a new project from a template commits via the api 8065812 passed -
Create Merge request push options removes the source branch 8065812 passed -
Create batch comments in merge request user submits a non-diff review 8065842 passed -
Create batch comments in merge request user submits a diff review 8065842 passed -
Create Push Rules using non signed commits restricts committing files with secrets 8065842 passed -
Create Push Rules using non signed commits restricts users by email format 8065842 passed -
Create Push Rules using non signed commits restricts branches by branch name 8065842 passed -
Create Push Rules using non signed commits restricts files by name and size 8065842 passed -
Create Push Rules using non signed commits restricts removal of tag 8065842 passed -
Create Push Rules using non signed commits restricts commit by message format 8065842 passed -
Create Push Rules using non signed commits allows an unrestricted push 8065842 passed -
Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users 8065842 passed -
Create Push Rules with commits restricted to verified emails rejects unverified emails 8065842 passed -
Create Push Rules using signed commits restricts to signed commits 8065842 passed -
Create Codeowners displays owners specified in CODEOWNERS file 8065842 passed -
Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled 8065842 passed -
Create Wiki Creating pages in Group Wikis when Wiki is empty creates a home page 8065842 passed -
Create Wiki Creating pages in Group Wikis when Wiki has a home page adds a second page 8065842 passed -
Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth 8065842 passed -
Create Project templates when group level successfully imports the project using template 8065842 quarantine passed -
Create Approval rules allows multiple approval rules with users and groups 8065842 passed -
Create File Locking checks file locked by other user to be disabled 8065842 passed -
Create File Locking locks a file and tries to push as a second user 8065842 passed -
Create File Locking locks a file and unlocks in list 8065842 passed -
Create File Locking locks a directory and tries to push as a second user 8065842 passed -
Create File Locking creates a merge request and fails to merge 8065842 passed -
Create Contribution Analytics tests contributions 8065842 passed -
Create Codeowners merge request assigns code owners as approvers 8065842 passed -
Create Default merge request templates uses default template when creating a merge request 8065842 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 8065834 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 8065834 passed -
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 8065834 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 8065834 passed -
Create Add a directory in Web IDE when a directory with the same name already exists throws an error 8065834 passed -
Create Commit data user views raw email patch 8065834 passed -
Create Commit data user views raw commit diff 8065834 passed -
Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 8065834 passed -
Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 8065834 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 8065834 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 8065834 passed -
Create Wiki has changed the directory 8065834 passed -
Create Wiki testing wiki content creation inside a project by adding a home page to the wiki using git push 8065834 passed -
Create Wiki testing wiki content creation inside a project by adding a second page to the wiki 8065834 passed -
Create Wiki testing wiki content creation inside a project by adding a second page to the wiki using git push 8065834 passed -
Create Wiki testing wiki content creation inside a project by adding a home page to the wiki 8065834 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 8065834 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 8065834 passed -
Create Reverting a commit creates a merge request 8065834 passed -
Create Merged merge request can be reverted 8065834 passed -
Create Web IDE file templates user adds .gitignore via file template Android 8065834 passed -
Create Web IDE file templates user adds Dockerfile via file template Python 8065834 passed -
Create Web IDE file templates user adds LICENSE via file template Mozilla Public License 2.0 8065834 passed -
Create Web IDE file templates user adds .gitlab-ci.yml via file template Julia 8065834 passed -
Create File management user deletes a file via the Web 8065834 passed -
Create Add suggestions to a Merge Request applies a single suggestion with a custom message 8065834 passed -
Create Content Editor creates a formatted Wiki page with an image uploaded 8065834 passed -
Create File management user edits a file via the Web 8065834 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 8065834 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 8065834 passed -
Create File templates user adds LICENSE via file template Mozilla Public License 2.0 8065839 passed -
Create File templates user adds Dockerfile via file template Python 8065839 passed -
Create Create a new merge request creates a basic merge request 8065839 passed -
Create Create a new merge request creates a merge request with a milestone and label 8065839 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file 8065839 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file 8065839 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number 8065839 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number 8065839 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number 8065839 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number 8065839 passed -
Create Add batch suggestions to a Merge Request applies multiple suggestions 8065839 passed -
Create Multiple file snippet creates a personal snippet with multiple files 8065839 passed -
Create Personal snippet creation user creates a personal snippet 8065839 passed -
Create File management user creates a file via the Web 8065839 passed -
Create Cherry picking from a merge request creates a merge request 8065839 passed -
Create Merge requests when merging once behaves like merge when pipeline succeeds merges after pipeline succeeds 8065839 passed -
Create SSH keys support user can add an SSH key 8065839 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 8065839 passed -
Create Merge request squashing user squashes commits while merging 8065839 passed -
Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly 8065839 passed -
Create Merge request rebasing user rebases source branch of merge request 8065839 passed -
Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository 8065839 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the API 8065839 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI 8065839 passed -
Other tests:
Test Job Status Action
Create Open a fork in Web IDE when a user does not have permissions to commit to the project when a fork is already created opens the fork when a user clicks Web IDE in the main project 8065836 pending -
Create Open a fork in Web IDE when a user does not have permissions to commit to the project when no fork is present suggests to create a fork when a user clicks Web IDE in the main project 8065836 pending -
Create Merge request creation from fork can merge feature branch fork to mainline 8065836 quarantine pending -
Create Web IDE web terminal user starts the web terminal 8065834 quarantine pending -
Create Source editor toolbar preview can preview markdown side-by-side while editing 8065834 pending -
Create Pages creates a Pages website 8065839 pending -

Verify

  • Total 46 tests
  • Passed 4 tests
  • Failed 34 tests
  • 8 other tests (usually skipped)
Test Job Status Action
Verify Add or Remove CI variable via UI user adds a CI variable 8065845 failed
  • failure issue exists or was created
Verify Runner registration user registers a new specific runner 8065845 failed
  • failure issue exists or was created
Verify Code coverage statistics creates an MR with code coverage statistics 8065845 failed
  • failure issue exists or was created
Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 8065845 failed
  • failure issue exists or was created
Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 8065845 failed
  • failure issue exists or was created
Verify Pipeline with protected variable exposes variable on protected branch 8065845 failed
  • failure issue exists or was created
Verify Pipeline with protected variable does not expose variable on unprotected branch 8065845 failed
  • failure issue exists or was created
Verify Pipeline editor can switch branches and target branch field updates accordingly 8065845 failed
  • failure issue exists or was created
Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page 8065845 failed
  • failure issue exists or was created
Verify Update CI file with pipeline editor creates new pipeline and target branch 8065845 failed
  • failure issue exists or was created
Verify When job is configured to only run on merge_request_events only runs the job configured to run on merge requests 8065845 failed
  • failure issue exists or was created
Verify Pipeline editor when CI has valid syntax shows valid validations 8065845 failed
  • failure issue exists or was created
Verify Pipeline editor when CI has invalid syntax shows invalid validations 8065845 failed
  • failure issue exists or was created
Verify When pipeline is blocked can still merge MR successfully 8065845 failed
  • failure issue exists or was created
Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value 8065845 failed
  • failure issue exists or was created
Verify UI defined variable is not inheritable when forward:pipeline_variables is false 8065848 failed
  • failure issue exists or was created
Verify UI defined variable is not inheritable by default 8065848 failed
  • failure issue exists or was created
Verify Pipeline editor can create merge request 8065848 failed
  • failure issue exists or was created
Verify Include multiple files from a project runs the pipeline with composed config 8065848 failed
  • failure issue exists or was created
Verify Run pipeline with manual jobs does not leave any job in skipped state 8065848 failed
  • failure issue exists or was created
Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config 8065848 failed
  • failure issue exists or was created
Verify Run pipeline with web only rule can trigger pipeline 8065848 failed
  • failure issue exists or was created
Verify UI defined variable is inheritable when forward:pipeline_variables is true 8065848 failed
  • failure issue exists or was created
Verify Include local config file paths with wildcard runs the pipeline with composed config 8065848 failed
  • failure issue exists or was created
Verify Trigger child pipeline with 'when:manual' can trigger bridge job 8065848 failed
  • failure issue exists or was created
Verify Endpoint Coverage spans r/w postgres web sidekiq git api 8065848 failed
  • failure issue exists or was created
Verify In merge trains new thread discussion does not drop MR 8065851 failed
  • failure issue exists or was created
Verify Pipelines for merged results and merge trains merges via a merge train 8065851 failed
  • failure issue exists or was created
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 8065851 failed
  • failure issue exists or was created
Verify Operations Dashboard has many pipelines with appropriate statuses 8065851 failed
  • failure issue exists or was created
Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project 8065851 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 8065851 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 8065851 failed
  • failure issue exists or was created
Verify Multi-project pipelines creates a multi-project pipeline with artifact download 8065851 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Add or Remove CI variable via UI user removes a CI variable 8065845 passed -
Verify Runner removal removes the runner 8065812 passed -
Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition 8065812 passed -
Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables 8065848 passed -
Other tests:
Test Job Status Action
Verify Pipeline with project file variables when FF is on behaves like variables are read correctly shows in job log accordingly 8065812 pending -
Verify Pipeline with project file variables when FF is off behaves like variables are read correctly shows in job log accordingly 8065812 pending -
Verify Pipeline creation and processing users creates a pipeline which gets processed 8065848 quarantine pending -
Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly 8065848 quarantine pending -
Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly 8065848 quarantine pending -
Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly 8065848 quarantine pending -
Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly 8065848 quarantine pending -
Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message 8065848 quarantine pending -

Package

  • Total 46 tests
  • Passed 26 tests
  • Failed 9 tests
  • 11 other tests (usually skipped)
Test Job Status Action
Package Generic Repository uploads a generic package and downloads it 8065855 failed
  • failure issue exists or was created
Package NuGet project level endpoint using a ci job token publishes a nuget package and installs 8065855 failed
  • failure issue exists or was created
Package NuGet project level endpoint using a project deploy token publishes a nuget package and installs 8065855 failed
Package NuGet project level endpoint using a personal access token publishes a nuget package and installs 8065855 failed
Package Package Registry npm instance level endpoint using project deploy token push and pull a npm package via CI 8065855 failed
  • failure issue exists or was created
Package Package Registry npm instance level endpoint using personal access token push and pull a npm package via CI 8065855 failed
Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package 8065853 failed
  • failure issue exists or was created
Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package 8065853 failed
Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package 8065853 failed
Passed tests:
Test Job Status Action
Package Package Registry npm instance level endpoint using ci job token push and pull a npm package via CI 8065855 passed -
Package Package Registry npm project level endpoint using ci job token push and pull a npm package via CI 8065855 passed -
Package Package Registry npm project level endpoint using project deploy token push and pull a npm package via CI 8065855 passed -
Package Package Registry npm project level endpoint using personal access token push and pull a npm package via CI 8065855 passed -
Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle 8065855 passed -
Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle 8065855 passed -
Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle 8065855 passed -
Package Terraform Module Registry publishes a module 8065855 passed -
Package PyPI Repository when at the project level publishes and installs a pypi package 8065859 passed -
Package Conan Repository publishes, installs, and deletes a Conan package 8065859 quarantine passed -
Package Composer Repository publishes a composer package and deletes it 8065859 passed -
Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven 8065859 passed -
Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven 8065859 passed -
Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven 8065859 passed -
Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint 8065859 passed -
Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint 8065859 passed -
Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint 8065859 passed -
Package Helm Registry using personal access token pushes and pulls a helm chart 8065859 passed -
Package Helm Registry using ci job token pushes and pulls a helm chart 8065859 passed -
Package Helm Registry using project deploy token pushes and pulls a helm chart 8065859 passed -
Package Maven group level endpoint duplication setting when enabled using a ci job token allows users to publish group level Maven packages duplicates 8065853 passed -
Package Maven group level endpoint duplication setting when enabled using a personal access token allows users to publish group level Maven packages duplicates 8065853 passed -
Package Maven group level endpoint duplication setting when enabled using a project deploy token allows users to publish group level Maven packages duplicates 8065853 passed -
Package Maven group level endpoint duplication setting when disabled using a ci job token prevents users from publishing group level Maven packages duplicates 8065853 passed -
Package Maven group level endpoint duplication setting when disabled using a project deploy token prevents users from publishing group level Maven packages duplicates 8065853 passed -
Package Maven group level endpoint duplication setting when disabled using a personal access token prevents users from publishing group level Maven packages duplicates 8065853 passed -
Other tests:
Test Job Status Action
Package RubyGems Repository publishes a Ruby gem 8065859 pending -
Package Dependency Proxy using docker:19.03.12 and a ci job token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:19.03.12 and a personal access token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:18.09.9 and a group deploy token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:20.10 and a group deploy token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:20.10 and a ci job token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:18.09.9 and a personal access token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:18.09.9 and a ci job token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:20.10 and a personal access token pulls an image using the dependency proxy 8065853 pending -
Package Dependency Proxy using docker:19.03.12 and a group deploy token pulls an image using the dependency proxy 8065853 pending -
Package Container Registry pushes, pulls image to the registry and deletes tag 8065812 pending -

Release

  • Total 4 tests
  • Passed 1 tests
  • Failed 3 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines 8065866 failed
  • failure issue exists or was created
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines 8065866 failed
  • failure issue exists or was created
Release Deploy key creation user adds a deploy key 8065866 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Release Deploy token creation user adds a deploy token 8065866 passed -

Configure

  • Total 3 tests
  • Passed 0 tests
  • Failed 0 tests
  • 3 other tests (usually skipped)
Other tests:
Test Job Status Action
Configure AutoDevOps Templates using express template works with Auto DevOps 8065872 pending -
Configure Auto DevOps with a Kubernetes Agent runs auto devops 8065872 pending -
Configure Kubernetes Agent deploys a K8s manifest file 8065817 pending -

Secure

  • Total 23 tests
  • Passed 0 tests
  • Failed 23 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Secure Project vulnerability report validates "fix a vulnerability" workflow 8065875 failed
  • failure issue exists or was created
Secure Security Dashboard in a Project creates an issue from vulnerability details 8065875 failed
  • failure issue exists or was created
Secure Security Dashboard in a Project shows vulnerability details 8065875 failed
  • failure issue exists or was created
Secure Scan result policy requires approval when a pipeline report has findings matching the scan result policy 8065875 failed
  • failure issue exists or was created
Secure License merge request widget manage licenses from the merge request 8065875 failed
  • failure issue exists or was created
Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration 8065875 failed
  • failure issue exists or was created
Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration 8065875 failed
  • failure issue exists or was created
Secure Security Reports in a Merge Request can dismiss a vulnerability with a reason 8065875 failed
  • failure issue exists or was created
Secure Security Reports in a Merge Request can create an issue from a vulnerability 8065875 failed
  • failure issue exists or was created
Secure Security Reports in a Merge Request can create an auto-remediation MR 8065875 failed
  • failure issue exists or was created
Secure project vulnerability report can successfully change status of a vulnerability in vulnerability details page 8065875 failed
  • failure issue exists or was created
Secure project vulnerability report can successfully bulk change status in vulnerability report 8065875 failed
  • failure issue exists or was created
Secure Security Reports in a Merge Request displays the Security reports in the merge request 8065875 failed
  • failure issue exists or was created
Secure Security Reports displays security reports in the pipeline 8065875 failed
  • failure issue exists or was created
Secure Security Reports displays security reports in the project security dashboard 8065875 failed
  • failure issue exists or was created
Secure Security Reports displays security reports in the group security dashboard 8065875 failed
  • failure issue exists or was created
Secure Security Reports displays false positives for the vulnerabilities 8065875 failed
  • failure issue exists or was created
Secure Security Reports displays the Dependency List 8065875 failed
  • failure issue exists or was created
Secure Security Reports dependency list has empty state 8065875 failed
  • failure issue exists or was created
Secure License Compliance has empty state 8065875 failed
  • failure issue exists or was created
Secure License Compliance License Management can approve a license in the settings page 8065875 failed
  • failure issue exists or was created
Secure License Compliance License Management can deny a license in the settings page 8065875 failed
  • failure issue exists or was created
Secure License Compliance License Management Pipeline Licence tab can approve and deny licenses in the pipeline 8065875 failed
  • failure issue exists or was created

Link to Grafana dashboard for run-type of canary-full