Skip to content
Snippets Groups Projects

2023-05-11 Test session report | production-full

Session summary

  • Deploy version:
  • Deploy environment: production
  • Pipeline: production 1930095
  • Total 336 tests
  • Passed 228 tests
  • Failed 54 tests
  • 54 other tests (usually skipped)

Failed jobs

Manage

  • Total 14 tests
  • Passed 9 tests
  • Failed 0 tests
  • 5 other tests (usually skipped)
Passed tests:
Test Job Status Action
Manage Group access tokens can be created and revoked via the UI 10021744 passed -
Manage basic user login user logs in using basic credentials and logs out 10021744 passed -
Manage Project access tokens can be created and revoked via the UI 10021744 passed -
Manage Group access token can be used to create a file via the project API 10021741 passed -
Manage Group access token can be used to commit via the API 10021741 passed -
Manage Project access token for the same project can be used to commit via the API 10021741 passed -
Manage Project access token for the same project can be used to create a file via the project API 10021741 passed -
Manage Project access token for a different project cannot be used to create a file via the project API 10021741 passed -
Manage Project access token for a different project cannot be used to commit via the API 10021741 passed -
Other tests:
Test Job Status Action
Create Slack app integration when using Slash commands creates an issue 10021745 pending -
Create Slack app integration when using Slash commands with gitlab issue displays an issue 10021745 pending -
Create Slack app integration when using Slash commands with gitlab issue comments on an issue 10021745 pending -
Create Slack app integration when using Slash commands with gitlab issue closes an issue 10021745 pending -
Create Slack app integration when using Slash commands with gitlab issue with target project moves an issue 10021745 pending -

Plan

  • Total 74 tests
  • Passed 73 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Plan Epics milestone dates API updates epic dates when updating milestones 10021742 passed -
Plan Epics milestone dates API updates epic dates when removing issue 10021742 passed -
Plan Epics milestone dates API updates epic dates when deleting milestones 10021742 passed -
Plan Epics milestone dates API updates epic dates when adding another issue 10021742 passed -
Plan Issue comments comments on an issue and edits the comment 10021746 passed -
Plan Testing wiki content manipulation inside a project by manipulating content on the page 10021746 passed -
Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push 10021746 passed -
Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 10021746 passed -
Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 10021746 passed -
Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 10021746 passed -
Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 10021746 passed -
Plan Design Management user adds a design and annotates it 10021746 passed -
Plan Testing wiki content creation inside a project by adding a second page to the wiki 10021746 passed -
Plan Testing wiki content creation inside a project by adding a home page to the wiki 10021746 passed -
Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push 10021746 passed -
Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push 10021746 passed -
Plan Group milestone creates a group milestone 10021746 passed -
Plan Design Management user adds a design and modifies it 10021746 passed -
Plan A project wiki can change the directory path of a page 10021746 passed -
Plan Project Wiki with Wiki Page List has all expected links that work 10021746 passed -
Plan Project Wiki with Wiki Sidebar has all expected links that work 10021746 passed -
Plan issue suggestions shows issue suggestions when creating a new issue 10021746 passed -
Plan Testing project wiki file upload by creating a formatted page with an image uploaded 10021746 quarantine passed -
Plan Project milestone creates a project milestone 10021746 passed -
Plan Related issues relates and unrelates one issue to/from another 10021746 passed -
Plan Issue creation closes an issue 10021746 passed -
Plan Issue creation creates an issue 10021746 passed -
Plan Issue creation when using attachments in comments comments on an issue with an attachment 10021746 passed -
Plan Testing project wiki can delete a page 10021746 passed -
Plan mention mentions another user in an issue 10021746 passed -
Plan filter issue comments activities filters comments and activities in an issue 10021746 passed -
Plan Issues list successfully exports issues list as CSV 10021746 passed -
Plan Issue board focus mode focuses on issue board 10021746 passed -
Plan Assignees update without refresh 10021746 passed -
Plan Custom issue templates creates an issue via custom template 10021746 passed -
Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 10021746 passed -
Plan Design Management user archives a design 10021746 passed -
Plan Issue closes via pushing a commit 10021741 passed -
Plan Group issue boards creates a group issue board via the GUI 10021748 passed -
Plan for group insights page behaves like default insights page displays issues and merge requests dashboards 10021748 passed -
Plan for project insights page behaves like default insights page displays issues and merge requests dashboards 10021748 passed -
Plan Configure issue board by label shows only issues that match the configured label 10021748 passed -
Plan Creating pages in group wikis when wiki has a home page adds a second page 10021748 passed -
Plan Creating pages in group wikis when wiki is empty creates a new page 10021748 passed -
Plan Testing group wiki can delete a group wiki page 10021748 passed -
Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 10021748 passed -
Plan Default issue templates uses default template when creating an issue 10021748 passed -
Plan Configurable issue board renames the issue board 10021748 passed -
Plan promote issue to epic promotes issue to epic 10021748 passed -
Plan Testing group wiki file upload by creating a formatted page with an image uploaded 10021748 quarantine passed -
Plan Contribution Analytics tests contributions 10021748 passed -
Plan Epics Management creates an epic 10021748 passed -
Plan Epics Management creates a confidential epic 10021748 passed -
Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 10021748 passed -
Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 10021748 passed -
Plan Epics Management Resources created via API Visit epic first comments on epic 10021748 passed -
Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 10021748 passed -
Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 10021748 passed -
Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 10021748 passed -
Plan Group issue boards shows multiple group boards in the boards dropdown menu 10021748 passed -
Plan Epics roadmap presents epic on roadmap 10021748 passed -
Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels 10021748 passed -
Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 10021748 passed -
Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 10021748 passed -
Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 10021748 passed -
Plan Assign Iterations assigns a group iteration to an existing issue 10021748 passed -
Plan Multiple assignees per issue shows four assignees in the issues list 10021748 passed -
Plan Burndown chart shows burndown chart on milestone page 10021748 passed -
Plan Group level issues analytics behaves like issues analytics page displays a graph 10021748 passed -
Plan Project level issues analytics behaves like issues analytics page displays a graph 10021748 passed -
Plan Read-only board configuration shows board configuration to user without edit permission 10021748 passed -
Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 10021748 passed -
Plan Group Iterations creates a group iteration automatically through an iteration cadence 10021748 passed -
Other tests:
Test Job Status Action
Plan Pages creates a Pages website 10021747 quarantine pending -

Create

  • Total 116 tests
  • Passed 107 tests
  • Failed 5 tests
  • 4 other tests (usually skipped)
Test Job Status Action
Create Download merge request patch and diff views the merge request patches 10021751 failed
Create Download merge request patch and diff views the merge request plain diff 10021751 failed
Create Merge request push options sets merge when pipeline succeeds 10021741 failed
  • failure issue exists or was created
Create Merge request push options merges when pipeline succeeds 10021741 failed
  • failure issue exists or was created
Create Merged merge request can be reverted 10021749 failed
Passed tests:
Test Job Status Action
Create Merge request custom templates creates a merge request via custom template 10021751 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number 10021751 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number 10021751 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number 10021751 passed -
Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number 10021751 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI 10021751 passed -
Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI 10021751 passed -
Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository 10021751 passed -
Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository 10021751 passed -
Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed 10021751 quarantine passed -
Create Add a directory in Web IDE when a directory with the same name already exists throws an error 10021751 quarantine passed -
Create File management user creates a file via the Web 10021751 passed -
Create Sharing snippets when the snippet is public can be shared with not signed-in users 10021751 passed -
Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 10021751 passed -
Create File templates user adds Dockerfile via file template Python 10021751 passed -
Create File templates user adds LICENSE via file template Mozilla Public License 2.0 10021751 passed -
Create File templates user adds .gitlab-ci.yml via file template Julia 10021751 passed -
Create File templates user adds .gitignore via file template Android 10021751 passed -
Create Git push over HTTP user using a personal access token pushes code to the repository 10021751 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI 10021751 passed -
Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI 10021751 passed -
Create with merge request suggestions applies a single suggestion with a custom message 10021751 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the API 10021751 passed -
Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI 10021751 passed -
Create Reverting a commit creates a merge request 10021751 passed -
Create Multiple file snippet creates a project snippet with multiple files 10021751 passed -
Create Push over HTTP using Git protocol version 2 user pushes to the repository 10021751 passed -
Create Create a new merge request creates a basic merge request 10021750 passed -
Create Create a new merge request creates a merge request with a milestone and label 10021750 passed -
Create File management user deletes a file via the Web 10021750 passed -
Create Cherry picking from a merge request creates a merge request 10021750 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet 10021750 passed -
Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet 10021750 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 10021750 passed -
Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 10021750 passed -
Create File management user edits a file via the Web 10021750 passed -
Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository 10021750 passed -
Create Merge request rebasing user rebases source branch of merge request 10021750 passed -
Create Commit data user views raw email patch 10021750 passed -
Create Commit data user views raw commit diff 10021750 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 10021750 passed -
Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 10021750 passed -
Create SSH key support pushes code to the repository via SSH 10021750 passed -
Create SSH key support pushes multiple branches and tags together 10021750 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 10021750 passed -
Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 10021750 passed -
Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 10021750 passed -
Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 10021750 passed -
Create Merge request squashing user squashes commits while merging 10021750 passed -
Create Personal snippet creation user creates a personal snippet 10021750 passed -
Create Multiple file snippet creates a personal snippet with multiple files 10021750 passed -
Create API basics user creates a project with a file and deletes them afterwards 10021741 passed -
Create API basics raw file access sets no-cache headers as expected 10021741 passed -
Create Merge request push options removes the source branch 10021741 passed -
Create Merge request push options sets title and description 10021741 passed -
Create Merge request push options sets labels 10021741 passed -
Create Merge request push options when labels are set already removes them on subsequent push 10021741 passed -
Create Merge request push options sets a target branch 10021741 passed -
Create Create a new project from a template commits via the api 10021741 passed -
Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different 10021741 passed -
Create PostReceive idempotent pushes and creates a single push event three times 10021741 passed -
Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository 10021752 quarantine passed -
Create Approval rules allows multiple approval rules with users and groups 10021752 passed -
Create Codeowners displays owners specified in CODEOWNERS file 10021752 passed -
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 10021752 passed -
Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 10021752 passed -
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 10021752 passed -
Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 10021752 passed -
Create Project templates when group level successfully imports the project using template 10021752 passed -
Create Default merge request templates uses default template when creating a merge request 10021752 passed -
Create batch comments in merge request user submits a diff review 10021752 passed -
Create batch comments in merge request user submits a non-diff review 10021752 passed -
Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users 10021752 passed -
Create Push Rules with commits restricted to verified emails rejects unverified emails 10021752 passed -
Create Push Rules using signed commits restricts to signed commits 10021752 passed -
Create Push Rules using non signed commits restricts files by name and size 10021752 passed -
Create Push Rules using non signed commits allows an unrestricted push 10021752 passed -
Create Push Rules using non signed commits restricts branches by branch name 10021752 passed -
Create Push Rules using non signed commits restricts users by email format 10021752 passed -
Create Push Rules using non signed commits restricts commit by message format 10021752 passed -
Create Push Rules using non signed commits restricts committing files with secrets 10021752 passed -
Create Push Rules using non signed commits restricts removal of tag 10021752 passed -
Create Codeowners merge request assigns code owners as approvers 10021752 passed -
Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth 10021752 passed -
Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled 10021752 passed -
Create File Locking checks file locked by other user to be disabled 10021752 passed -
Create File Locking creates a merge request and fails to merge 10021752 passed -
Create File Locking locks a directory and tries to push as a second user 10021752 passed -
Create File Locking locks a file and tries to push as a second user 10021752 passed -
Create File Locking locks a file and unlocks in list 10021752 passed -
Create Git clone over HTTP user performs a deep clone 10021749 passed -
Create Git clone over HTTP user performs a shallow clone 10021749 passed -
Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository 10021749 passed -
Create Cherry picking a commit creates a merge request 10021749 passed -
Create Project snippet creation user creates a project snippet 10021749 passed -
Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 10021749 passed -
Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 10021749 passed -
Create with merge request batch suggestions applies multiple suggestions 10021749 passed -
Create Merge request creation from fork can merge source branch from fork into upstream repository 10021749 passed -
Create SSH keys support user can add an SSH key 10021749 passed -
Create SSH keys support after adding an ssh key can delete an ssh key 10021749 passed -
Create Push over SSH using Git protocol version 2 user pushes to the repository 10021749 passed -
Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly 10021749 passed -
Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly 10021749 passed -
Create Git push over HTTP user pushes code to the repository 10021749 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file 10021749 passed -
Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file 10021749 passed -
Other tests:
Test Job Status Action
Create Branch Rules Overview adds a new branch rule 10021751 quarantine pending -
Create Remote Development creates a new workspace using a devfile from a project 10021752 quarantine pending -
Create Source editor toolbar preview can preview markdown side-by-side while editing 10021749 pending -
Create Merge requests when merging once behaves like merge when pipeline succeeds merges after pipeline succeeds 10021749 quarantine pending -

Verify

  • Total 32 tests
  • Passed 3 tests
  • Failed 27 tests
  • 2 other tests (usually skipped)
Test Job Status Action
Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 10021755 failed
  • failure issue exists or was created
Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 10021755 failed
  • failure issue exists or was created
Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project 10021755 failed
  • failure issue exists or was created
Verify Pipelines for merged results and merge trains merges via a merge train 10021755 failed
  • failure issue exists or was created
Verify Pipelines for merged results and merge trains creates a pipeline with merged results 10021755 failed
  • failure issue exists or was created
Verify Multi-project pipelines creates a multi-project pipeline with artifact download 10021755 failed
  • failure issue exists or was created
Verify Runner registration user registers a new project runner 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful 10021754 failed
  • failure issue exists or was created
Verify Pipeline with protected variable does not expose variable on unprotected branch 10021754 failed
  • failure issue exists or was created
Verify Pipeline with protected variable exposes variable on protected branch 10021754 failed
  • failure issue exists or was created
Verify UI defined variable is inheritable when forward:pipeline_variables is true 10021754 failed
  • failure issue exists or was created
Verify UI defined variable is not inheritable when forward:pipeline_variables is false 10021754 failed
  • failure issue exists or was created
Verify UI defined variable is not inheritable by default 10021754 failed
  • failure issue exists or was created
Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline 10021754 failed
  • failure issue exists or was created
Verify Pipeline with raw variables in YAML expands variables according to expand: true/false 10021754 failed
  • failure issue exists or was created
Verify Include multiple files from a project runs the pipeline with composed config 10021754 failed
  • failure issue exists or was created
Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables 10021754 failed
  • failure issue exists or was created
Verify Endpoint Coverage spans r/w postgres web sidekiq git api 10021754 failed
  • failure issue exists or was created
Verify Code coverage statistics creates an MR with code coverage statistics 10021754 failed
  • failure issue exists or was created
Verify Pipeline with project file variables does not expose file variable content with echo 10021741 failed
  • failure issue exists or was created
Verify Pipeline with project file variables can read file variable content with cat 10021741 failed
  • failure issue exists or was created
Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition 10021741 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined 10021754 passed -
Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page 10021754 passed -
Verify Include local config file paths with wildcard runs the pipeline with composed config 10021754 passed -
Other tests:
Test Job Status Action
Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline 10021754 quarantine pending -
Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline 10021754 quarantine pending -

Package

  • Total 23 tests
  • Passed 0 tests
  • Failed 4 tests
  • 19 other tests (usually skipped)
Test Job Status Action
Package Conan Repository publishes, installs, and deletes a Conan package 10021756 quarantine failed
  • failure issue exists or was created
Package Terraform Module Registry publishes a module 10021757 failed
  • failure issue exists or was created
Package Generic Repository uploads a generic package and downloads it 10021758 failed
Package Composer Repository publishes a composer package and deletes it 10021758 failed
  • failure issue exists or was created
Other tests:
Test Job Status Action
Package Dependency Proxy using docker:19.03.12 and a personal access token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:19.03.12 and a ci job token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:18.09.9 and a ci job token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:18.09.9 and a group deploy token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:20.10 and a ci job token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:20.10 and a group deploy token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:18.09.9 and a personal access token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:20.10 and a personal access token pulls an image using the dependency proxy 10021756 pending -
Package Dependency Proxy using docker:19.03.12 and a group deploy token pulls an image using the dependency proxy 10021756 pending -
Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven 10021756 pending -
Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven 10021756 pending -
Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven 10021756 pending -
Package Container Registry pushes, pulls image to the registry and deletes tag 10021741 pending -
Package RubyGems Repository publishes a Ruby gem 10021757 pending -
Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package 10021758 pending -
Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package 10021758 pending -
Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package 10021758 pending -
Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates 10021758 pending -
Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates 10021758 pending -

Release

  • Total 6 tests
  • Passed 2 tests
  • Failed 4 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines 10021760 failed
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines 10021760 failed
Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines 10021760 failed
Release Operations Dashboard has many pipelines with appropriate statuses 10021761 failed
Passed tests:
Test Job Status Action
Release Deploy key creation user adds a deploy key 10021760 passed -
Release Deploy token creation user adds a deploy token 10021760 passed -

Configure

  • Total 3 tests
  • Passed 2 tests
  • Failed 0 tests
  • 1 other tests (usually skipped)
Passed tests:
Test Job Status Action
Configure Kubernetes Agent deploys a K8s manifest file 10021742 passed -
Configure Auto DevOps with a Kubernetes Agent runs auto devops 10021762 passed -
Other tests:
Test Job Status Action
Configure AutoDevOps Templates using express template works with Auto DevOps 10021762 pending -

Monitor

  • Total 10 tests
  • Passed 8 tests
  • Failed 0 tests
  • 2 other tests (usually skipped)
Passed tests:
Test Job Status Action
Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert 10021763 passed -
Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only resolves the correct alert 10021763 quarantine passed -
Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident 10021763 passed -
Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident 10021763 passed -
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert creates new alert 10021763 passed -
Monitor Alert settings when using Prometheus integration behaves like sends test alert creates new alert 10021763 passed -
Monitor Alert settings when using Prometheus integration behaves like sends test alert using authorization key creates new alert 10021763 passed -
Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert using authorization key creates new alert 10021763 passed -
Other tests:
Test Job Status Action
Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident 10021763 quarantine pending -
Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident 10021763 quarantine pending -

Secure

  • Total 11 tests
  • Passed 2 tests
  • Failed 0 tests
  • 9 other tests (usually skipped)
Passed tests:
Test Job Status Action
Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration 10021765 passed -
Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration 10021765 passed -
Other tests:
Test Job Status Action
Secure License merge request widget when a license scanning report exists manage licenses from the merge request 10021765 quarantine pending -
Secure License merge request widget when a CycloneDX SBOM file exists manage licenses from the merge request 10021765 quarantine pending -
Secure License Compliance has empty state 10021765 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like approve license can approve a license in the settings page 10021765 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 10021765 quarantine pending -
Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like deny license can deny a license in the settings page 10021765 quarantine pending -
Secure License Compliance when a license management report exists License Management behaves like approve license can approve a license in the settings page 10021765 quarantine pending -
Secure License Compliance when a license management report exists License Management behaves like deny license can deny a license in the settings page 10021765 quarantine pending -
Secure License Compliance when a license management report exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 10021765 quarantine pending -

Data_stores

  • Total 14 tests
  • Passed 3 tests
  • Failed 0 tests
  • 11 other tests (usually skipped)
Passed tests:
Test Job Status Action
Data Stores Users API GET /users/:username with an invalid username 10021741 passed -
Data Stores Users API GET /users 10021741 passed -
Data Stores Users API GET /users/:username with a valid username 10021741 passed -
Other tests:
Test Job Status Action
Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content 10021743 pending -
Data Stores When using elasticsearch API to search for a public issue finds issue that matches description 10021743 pending -
Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message 10021743 pending -
Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description 10021743 pending -
Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 10021743 pending -
Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user 10021743 pending -
Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user 10021743 pending -
Data Stores When using elasticsearch API to search for a public note finds note that matches note body 10021743 pending -
Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name 10021743 pending -
Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description 10021743 pending -
Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 10021743 pending -

Govern

  • Total 33 tests
  • Passed 19 tests
  • Failed 14 tests
  • 0 other tests (usually skipped)
Test Job Status Action
Govern Security Reports dependency list has empty state 10021764 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the project security dashboard 10021764 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the pipeline 10021764 failed
  • failure issue exists or was created
Govern Security Reports displays false positives for the vulnerabilities 10021764 failed
  • failure issue exists or was created
Govern Security Reports displays security reports in the group security dashboard 10021764 failed
  • failure issue exists or was created
Govern Security Reports displays the Dependency List 10021764 failed
  • failure issue exists or was created
Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget 10021764 failed
  • failure issue exists or was created
Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy 10021764 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab 10021764 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab 10021764 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget 10021764 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget 10021764 failed
  • failure issue exists or was created
Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget 10021764 failed
  • failure issue exists or was created
Govern Project vulnerability report validates "fix a vulnerability" workflow 10021764 failed
  • failure issue exists or was created
Passed tests:
Test Job Status Action
Govern Policies List page can navigate to Policy Editor page 10021764 passed -
Govern Policies List page can load Policies page and view the policies list 10021764 passed -
Govern Security Dashboard in a Project shows vulnerability details 10021764 passed -
Govern Security Dashboard in a Project creates an issue from vulnerability details 10021764 passed -
Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for change project creation level behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations 10021764 passed -
Govern project vulnerability report can successfully bulk change status in vulnerability report 10021764 passed -
Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page 10021764 passed -
Govern Group for update group name behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for add and remove project access behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Group for add group behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Project for change visibility behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Project for project archive and unarchive behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Project for add user access as guest behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Project for add deploy key behaves like audit event logs audit events for UI operations 10021764 passed -
Govern Project for add project behaves like audit event logs audit events for UI operations 10021764 passed -

Link to Grafana dashboard for run-type of production-full