Skip to content
Snippets Groups Projects

2023-05-09 Test session report | production-full

Session summary

  • Deploy version:
  • Deploy environment: production
  • Pipeline: production 1924421
  • Total 357 tests
  • Passed 242 tests
  • Failed 59 tests
  • 56 other tests (usually skipped)

Failed jobs

Manage

  • Total 14 tests
  • Passed 7 tests
  • Failed 2 tests
  • 5 other tests (usually skipped)
Test Job Status Action
Manage Group access token can be used to create a file via the project API 9998848 failed
Manage Group access token can be used to commit via the API 9998848 failed
Passed tests:
Test Job Status Action
Manage Project access token for a different project cannot be used to commit via the API 9998848 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 9998848 passed -
Manage Project access token for the same project can be used to commit via the API 9998848 passed -
Manage Project access token for the same project can be used to create a file via the project API 9998848 passed -
Manage Project access tokens can be created and revoked via the UI 9998851 passed -
Manage Group access tokens can be created and revoked via the UI 9998851 passed -
Manage basic user login user logs in using basic credentials and logs out 9998851 passed -
Other tests:
Test Job Status Action
Create Slack app integration when using Slash commands creates an issue 9998852 pending -
Create Slack app integration when using Slash commands with gitlab issue comments on an issue 9998852 pending -
Create Slack app integration when using Slash commands with gitlab issue closes an issue 9998852 pending -
Create Slack app integration when using Slash commands with gitlab issue displays an issue 9998852 pending -
Create Slack app integration when using Slash commands with gitlab issue with target project moves an issue 9998852 pending -

Plan

  • Total 74 tests
  • Passed 73 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Plan Issue closes via pushing a commit 9998848 passed -
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 9998855 passed -
Plan Testing group wiki file upload by creating a formatted page with an image uploaded 9998855 quarantine passed -
Plan Epics roadmap presents epic on roadmap 9998855 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 9998855 passed -
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 9998855 passed -
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 9998855 passed -
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 9998855 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 9998855 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 9998855 passed -
Plan Configure issue board by label shows only issues that match the configured label 9998855 passed -
Plan Read-only board configuration shows board configuration to user without edit permission 9998855 passed -
Plan for group insights page behaves like default insights page displays issues and merge requests dashboards 9998855 passed -
Plan for project insights page behaves like default insights page displays issues and merge requests dashboards 9998855 passed -
Plan Epics Management creates a confidential epic 9998855 passed -
Plan Epics Management creates an epic 9998855 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 9998855 passed -
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 9998855 passed -
Plan Epics Management Resources created via API Visit epic first comments on epic 9998855 passed -
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 9998855 passed -
Plan promote issue to epic promotes issue to epic 9998855 passed -
Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels 9998855 passed -
Plan Burndown chart shows burndown chart on milestone page 9998855 passed -
Plan Default issue templates uses default template when creating an issue 9998855 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 9998855 passed -
Plan Group level issues analytics behaves like issues analytics page displays a graph 9998855 passed -
Plan Creating pages in group wikis when wiki has a home page adds a second page 9998855 passed -
Plan Creating pages in group wikis when wiki is empty creates a new page 9998855 passed -
Plan Testing group wiki can delete a group wiki page 9998855 passed -
Plan Configurable issue board renames the issue board 9998855 passed -
Plan Multiple assignees per issue shows four assignees in the issues list 9998855 passed -
Plan Contribution Analytics tests contributions 9998855 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 9998855 passed -
Plan Group Iterations creates a group iteration automatically through an iteration cadence 9998855 passed -
Plan Assign Iterations assigns a group iteration to an existing issue 9998855 passed -
Plan Group issue boards creates a group issue board via the GUI 9998855 passed -
Plan Assignees update without refresh 9998853 passed -
Plan Testing project wiki file upload by creating a formatted page with an image uploaded 9998853 quarantine passed -
Plan mention mentions another user in an issue 9998853 passed -
Plan A project wiki can change the directory path of a page 9998853 passed -
Plan Design Management user adds a design and modifies it 9998853 passed -
Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push 9998853 passed -
Plan Testing wiki content creation inside a project by adding a home page to the wiki 9998853 passed -
Plan Testing wiki content creation inside a project by adding a second page to the wiki 9998853 passed -
Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push 9998853 passed -
Plan Project milestone creates a project milestone 9998853 passed -
Plan Project Wiki with Wiki Sidebar has all expected links that work 9998853 passed -
Plan Project Wiki with Wiki Page List has all expected links that work 9998853 passed -
Plan issue suggestions shows issue suggestions when creating a new issue 9998853 passed -
Plan Related issues relates and unrelates one issue to/from another 9998853 passed -
Plan Design Management user adds a design and annotates it 9998853 passed -
Plan Design Management user archives a design 9998853 passed -
Plan Testing wiki content manipulation inside a project by manipulating content on the page 9998853 passed -
Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push 9998853 passed -
Plan Testing project wiki can delete a page 9998853 passed -
Plan Issue comments comments on an issue and edits the comment 9998853 passed -
Plan Issue creation closes an issue 9998853 passed -
Plan Issue creation creates an issue 9998853 passed -
Plan Issue creation when using attachments in comments comments on an issue with an attachment 9998853 passed -
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 9998853 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 9998853 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 9998853 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 9998853 passed -
Plan Group milestone creates a group milestone 9998853 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 9998853 passed -
Plan Custom issue templates creates an issue via custom template 9998853 passed -
Plan Issue board focus mode focuses on issue board 9998853 passed -
Plan filter issue comments activities filters comments and activities in an issue 9998853 passed -
Plan Issues list successfully exports issues list as CSV 9998853 passed -
Plan Epics milestone dates API updates epic dates when adding another issue 9998849 passed -
Plan Epics milestone dates API updates epic dates when deleting milestones 9998849 passed -
Plan Epics milestone dates API updates epic dates when removing issue 9998849 passed -
Plan Epics milestone dates API updates epic dates when updating milestones 9998849 passed -
Other tests:
Test Job Status Action
Plan Pages creates a Pages website 9998854 quarantine pending -

Create

  • Total 116 tests
  • Passed 110 tests
  • Failed 2 tests
  • 4 other tests (usually skipped)
Test Job Status Action
Create Merge request push options sets merge when pipeline succeeds 9998848 failed
  • failure issue exists or was created
Create Merge request push options merges when pipeline succeeds 9998848 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Create API basics user creates a project with a file and deletes them afterwards 9998848 passed -
Create API basics raw file access sets no-cache headers as expected 9998848 passed -
Create PostReceive idempotent pushes and creates a single push event three times 9998848 passed -
Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different 9998848 passed -
Create Create a new project from a template commits via the api 9998848 passed -
Create Merge request push options removes the source branch 9998848 passed -
Create Merge request push options sets labels 9998848 passed -
Create Merge request push options when labels are set already removes them on subsequent push 9998848 passed -
Create Merge request push options sets title and description 9998848 passed -
Create Merge request push options sets a target branch 9998848 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 9998856 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 9998856 passed -
Create Git push over HTTP user using a personal access token pushes code to the repository 9998856 passed -
Create Download merge request patch and diff views the merge request patches 9998856 passed -
Create Download merge request patch and diff views the merge request plain diff 9998856 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI 9998856 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the API 9998856 passed -
Create Merge request rebasing user rebases source branch of merge request 9998856 passed -
Create SSH key support pushes code to the repository via SSH 9998856 passed -
Create SSH key support pushes multiple branches and tags together 9998856 passed -
Create Git clone over HTTP user performs a shallow clone 9998856 passed -
Create Git clone over HTTP user performs a deep clone 9998856 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI 9998856 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI 9998856 passed -
Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository 9998856 passed -
Create Merge request creation from fork can merge source branch from fork into upstream repository 9998856 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 9998856 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 9998856 passed -
Create File management user edits a file via the Web 9998856 passed -
Create Merge request custom templates creates a merge request via custom template 9998856 passed -
Create Git push over HTTP user pushes code to the repository 9998856 passed -
Create Push Rules using signed commits restricts to signed commits 9998859 passed -
Create Push Rules using non signed commits restricts commit by message format 9998859 passed -
Create Push Rules using non signed commits restricts files by name and size 9998859 passed -
Create Push Rules using non signed commits allows an unrestricted push 9998859 passed -
Create Push Rules using non signed commits restricts branches by branch name 9998859 passed -
Create Push Rules using non signed commits restricts committing files with secrets 9998859 passed -
Create Push Rules using non signed commits restricts removal of tag 9998859 passed -
Create Push Rules using non signed commits restricts users by email format 9998859 passed -
Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users 9998859 passed -
Create Push Rules with commits restricted to verified emails rejects unverified emails 9998859 passed -
Create File Locking locks a file and unlocks in list 9998859 passed -
Create File Locking checks file locked by other user to be disabled 9998859 passed -
Create File Locking locks a directory and tries to push as a second user 9998859 passed -
Create File Locking locks a file and tries to push as a second user 9998859 passed -
Create File Locking creates a merge request and fails to merge 9998859 passed -
Create Codeowners displays owners specified in CODEOWNERS file 9998859 passed -
Create Project templates when group level successfully imports the project using template 9998859 passed -
Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth 9998859 passed -
Create Codeowners merge request assigns code owners as approvers 9998859 passed -
Create Approval rules allows multiple approval rules with users and groups 9998859 passed -
Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled 9998859 passed -
Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository 9998859 quarantine passed -
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 9998859 passed -
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 9998859 passed -
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 9998859 passed -
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 9998859 passed -
Create Default merge request templates uses default template when creating a merge request 9998859 passed -
Create batch comments in merge request user submits a non-diff review 9998859 passed -
Create batch comments in merge request user submits a diff review 9998859 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 9998857 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 9998857 passed -
Create Create a new merge request creates a basic merge request 9998857 passed -
Create Create a new merge request creates a merge request with a milestone and label 9998857 passed -
Create Push over HTTP using Git protocol version 2 user pushes to the repository 9998857 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet 9998857 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet 9998857 passed -
Create Multiple file snippet creates a project snippet with multiple files 9998857 passed -
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 9998857 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 9998857 passed -
Create File management user deletes a file via the Web 9998857 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 9998857 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 9998857 passed -
Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 9998857 passed -
Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 9998857 passed -
Create Cherry picking from a merge request creates a merge request 9998857 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number 9998857 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number 9998857 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number 9998857 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number 9998857 passed -
Create File management user creates a file via the Web 9998857 passed -
Create with merge request batch suggestions applies multiple suggestions 9998857 passed -
Create Merge request squashing user squashes commits while merging 9998857 passed -
Create Commit data user views raw commit diff 9998857 passed -
Create Commit data user views raw email patch 9998857 passed -
Create Personal snippet creation user creates a personal snippet 9998857 passed -
Create Merged merge request can be reverted 9998858 passed -
Create Reverting a commit creates a merge request 9998858 passed -
Create Push over SSH using Git protocol version 2 user pushes to the repository 9998858 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file 9998858 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file 9998858 passed -
Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository 9998858 passed -
Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository 9998858 passed -
Create Project snippet creation user creates a project snippet 9998858 passed -
Create Multiple file snippet creates a personal snippet with multiple files 9998858 passed -
Create Cherry picking a commit creates a merge request 9998858 passed -
Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly 9998858 passed -
Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed 9998858 passed -
Create Add a directory in Web IDE when a directory with the same name already exists throws an error 9998858 passed -
Create SSH keys support user can add an SSH key 9998858 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 9998858 passed -
Create with merge request suggestions applies a single suggestion with a custom message 9998858 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI 9998858 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI 9998858 passed -
Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository 9998858 passed -
Create File templates user adds Dockerfile via file template Python 9998858 passed -
Create File templates user adds .gitignore via file template Android 9998858 passed -
Create File templates user adds LICENSE via file template Mozilla Public License 2.0 9998858 passed -
Create File templates user adds .gitlab-ci.yml via file template Julia 9998858 passed -
Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly 9998858 passed -
Other tests:
Test Job Status Action
Create Merge requests when merging once behaves like merge when pipeline succeeds merges after pipeline succeeds 9998856 quarantine pending -
Create Remote Development creates a new workspace using a devfile from a project 9998859 quarantine pending -
Create Branch Rules Overview adds a new branch rule 9998858 quarantine pending -
Create Source editor toolbar preview can preview markdown side-by-side while editing 9998858 pending -

Verify

  • Total 53 tests
  • Passed 16 tests
  • Failed 33 tests
  • 4 other tests (usually skipped)
Test Job Status Action
Verify Pipeline with project file variables does not expose file variable content with echo 9998848 failed
  • failure issue exists or was created
Verify Pipeline with project file variables can read file variable content with cat 9998848 failed
Verify Pipeline with protected variable exposes variable on protected branch 9998861 failed
  • failure issue exists or was created
Verify Pipeline with protected variable does not expose variable on unprotected branch 9998861 failed
  • failure issue exists or was created
Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 9998861 failed
  • failure issue exists or was created
Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 9998861 failed
  • failure issue exists or was created
Verify Runner registration user registers a new project runner 9998861 failed
  • failure issue exists or was created
Verify Trigger child pipeline with 'when:manual' can trigger bridge job 9998861 failed
  • failure issue exists or was created
Verify when pipeline is blocked can still merge MR successfully 9998861 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline 9998861 failed
  • failure issue exists or was created
Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables 9998861 failed
  • failure issue exists or was created
Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value 9998861 failed
  • failure issue exists or was created
Verify Code coverage statistics creates an MR with code coverage statistics 9998860 failed
  • failure issue exists or was created
Verify Update CI file with pipeline editor creates new pipeline and target branch 9998860 failed
  • failure issue exists or was created
Verify Endpoint Coverage spans r/w postgres web sidekiq git api 9998860 failed
  • failure issue exists or was created
Verify Pipeline with raw variables in YAML expands variables according to expand: true/false 9998860 failed
  • failure issue exists or was created
Verify Include multiple files from a project runs the pipeline with composed config 9998860 failed
  • failure issue exists or was created
Verify Run pipeline with manual jobs does not leave any job in skipped state 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 9998860 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful 9998860 failed
  • failure issue exists or was created
Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly 9998860 failed
  • failure issue exists or was created
Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly 9998860 failed
  • failure issue exists or was created
Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly 9998860 failed
  • failure issue exists or was created
Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly 9998860 failed
  • failure issue exists or was created
Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message 9998860 failed
  • failure issue exists or was created
Verify Pipelines for merged results and merge trains merges via a merge train 9998862 failed
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 9998862 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 9998862 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 9998862 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition 9998848 passed -
Verify Run pipeline with web only rule can trigger pipeline 9998861 passed -
Verify Pipeline editor can create merge request 9998861 passed -
Verify UI defined variable is not inheritable by default 9998861 passed -
Verify UI defined variable is not inheritable when forward:pipeline_variables is false 9998861 passed -
Verify Pipeline editor when CI has valid syntax shows valid validations 9998861 passed -
Verify Pipeline editor when CI has invalid syntax shows invalid validations 9998861 passed -
Verify Group runner registration user registers a new group runner 9998861 passed -
Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined 9998860 passed -
Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page 9998860 passed -
Verify UI defined variable is inheritable when forward:pipeline_variables is true 9998860 passed -
Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config 9998860 passed -
Verify Pipeline editor can switch branches and target branch field updates accordingly 9998860 passed -
Verify Include local config file paths with wildcard runs the pipeline with composed config 9998860 passed -
Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project 9998862 passed -
Verify Multi-project pipelines creates a multi-project pipeline with artifact download 9998862 passed -
Other tests:
Test Job Status Action
Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline 9998861 quarantine pending -
Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline 9998861 quarantine pending -
Verify Include multiple files from multiple projects when FF is on runs the pipeline with composed config 9998860 pending -
Verify Include multiple files from multiple projects when FF is off runs the pipeline with composed config 9998860 pending -

Package

  • Total 23 tests
  • Passed 0 tests
  • Failed 4 tests
  • 19 other tests (usually skipped)
Test Job Status Action
Package Generic Repository uploads a generic package and downloads it 9998865 failed
  • failure issue exists or was created
Package Composer Repository publishes a composer package and deletes it 9998865 failed
  • failure issue exists or was created
Package Conan Repository publishes, installs, and deletes a Conan package 9998863 quarantine failed
  • failure issue exists or was created
Package Terraform Module Registry publishes a module 9998864 failed
  • failure issue exists or was created
Other tests:
Test Job Status Action
Package Container Registry pushes, pulls image to the registry and deletes tag 9998848 pending -
Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package 9998865 pending -
Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package 9998865 pending -
Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package 9998865 pending -
Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates 9998865 pending -
Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates 9998865 pending -
Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven 9998863 pending -
Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven 9998863 pending -
Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven 9998863 pending -
Package Dependency Proxy using docker:18.09.9 and a personal access token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:18.09.9 and a group deploy token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:20.10 and a ci job token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:19.03.12 and a ci job token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:19.03.12 and a group deploy token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:20.10 and a group deploy token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:19.03.12 and a personal access token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:18.09.9 and a ci job token pulls an image using the dependency proxy 9998863 pending -
Package Dependency Proxy using docker:20.10 and a personal access token pulls an image using the dependency proxy 9998863 pending -
Package RubyGems Repository publishes a Ruby gem 9998864 pending -

Release

  • Total 6 tests
  • Passed 3 tests
  • Failed 3 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines 9998867 failed
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines 9998867 failed
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines 9998867 failed
Passed tests:
Test Job Status Action
Release Deploy token creation user adds a deploy token 9998867 passed -
Release Deploy key creation user adds a deploy key 9998867 passed -
Release Operations Dashboard has many pipelines with appropriate statuses 9998868 passed -

Configure

  • Total 3 tests
  • Passed 2 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Configure Auto DevOps with a Kubernetes Agent runs auto devops 9998869 passed -
Configure Kubernetes Agent deploys a K8s manifest file 9998849 passed -
Other tests:
Test Job Status Action
Configure AutoDevOps Templates using express template works with Auto DevOps 9998869 pending -

Monitor

  • Total 10 tests
  • Passed 8 tests
  • Failed 0 tests
  • 2 other tests (usually skipped)
Passed tests:
Test Job Status Action
Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert 9998870 passed -
Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only resolves the correct alert 9998870 quarantine passed -
Monitor Alert settings when using Prometheus integration behaves like sends test alert creates new alert 9998870 passed -
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert creates new alert 9998870 passed -
Monitor Alert settings when using Prometheus integration behaves like sends test alert using authorization key creates new alert 9998870 passed -
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert using authorization key creates new alert 9998870 passed -
Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident 9998870 passed -
Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident 9998870 passed -
Other tests:
Test Job Status Action
Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident 9998870 quarantine pending -
Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident 9998870 quarantine pending -

Secure

  • Total 11 tests
  • Passed 1 tests
  • Failed 1 tests
  • 9 other tests (usually skipped)
Test Job Status Action
Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration 9998872 failed
Passed tests:
Test Job Status Action
Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration 9998872 passed -
Other tests:
Test Job Status Action
Secure License Compliance has empty state 9998872 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like approve license can approve a license in the settings page 9998872 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 9998872 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like deny license can deny a license in the settings page 9998872 quarantine pending -
Secure License Compliance when a license management report exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 9998872 quarantine pending -
Secure License Compliance when a license management report exists License Management behaves like approve license can approve a license in the settings page 9998872 quarantine pending -
Secure License Compliance when a license management report exists License Management behaves like deny license can deny a license in the settings page 9998872 quarantine pending -
Secure License merge request widget when a license scanning report exists manage licenses from the merge request 9998872 quarantine pending -
Secure License merge request widget when a CycloneDX SBOM file exists manage licenses from the merge request 9998872 quarantine pending -

Data_stores

  • Total 14 tests
  • Passed 3 tests
  • Failed 0 tests
  • 11 other tests (usually skipped)
Passed tests:
Test Job Status Action
Data Stores Users API GET /users/:username with an invalid username 9998848 passed -
Data Stores Users API GET /users/:username with a valid username 9998848 passed -
Data Stores Users API GET /users 9998848 passed -
Other tests:
Test Job Status Action
Data Stores When using elasticsearch API to search for a public issue finds issue that matches description 9998850 pending -
Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 9998850 pending -
Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name 9998850 pending -
Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description 9998850 pending -
Data Stores When using elasticsearch API to search for a public note finds note that matches note body 9998850 pending -
Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message 9998850 pending -
Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 9998850 pending -
Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user 9998850 pending -
Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user 9998850 pending -
Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content 9998850 pending -
Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description 9998850 pending -

Govern

  • Total 33 tests
  • Passed 19 tests
  • Failed 14 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget 9998871 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the project security dashboard 9998871 failed
  • failure issue exists or was created
Govern Security Reports displays the Dependency List 9998871 failed
  • failure issue exists or was created
Govern Security Reports displays false positives for the vulnerabilities 9998871 failed
  • failure issue exists or was created
Govern Security Reports dependency list has empty state 9998871 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the pipeline 9998871 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the group security dashboard 9998871 failed
  • failure issue exists or was created
Govern Project vulnerability report validates "fix a vulnerability" workflow 9998871 failed
  • failure issue exists or was created
Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy 9998871 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget 9998871 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab 9998871 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab 9998871 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget 9998871 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget 9998871 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page 9998871 passed -
Govern project vulnerability report can successfully bulk change status in vulnerability report 9998871 passed -
Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for change project creation level behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for update group name behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for add and remove project access behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Group for add group behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Policies List page can navigate to Policy Editor page 9998871 passed -
Govern Policies List page can load Policies page and view the policies list 9998871 passed -
Govern Project for add user access as guest behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Project for project archive and unarchive behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Project for change visibility behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Project for add deploy key behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Project for add project behaves like audit event logs audit events for UI operations 9998871 passed -
Govern Security Dashboard in a Project shows vulnerability details 9998871 passed -
Govern Security Dashboard in a Project creates an issue from vulnerability details 9998871 passed -

Link to Grafana dashboard for run-type of production-full