Skip to content
Snippets Groups Projects

2023-04-18 Test session report | canary-full

    • Closed Issue created by Ghost User @ghost1

    Session summary

    • Deploy version: 15.11.202304181820-a8353df2715.f3bf34ebcf3
    • Deploy environment: gprd-cny
    • Pipeline: canary 1873014
    • Total 357 tests
    • Passed 268 tests
    • Failed 35 tests
    • 54 other tests (usually skipped)

    Failed jobs

    Manage

    • Total 15 tests
    • Passed 8 tests
    • Failed 1 tests
    • 6 other tests (usually skipped)
    Test Job Status Action
    Manage Group access token can be used to create a file via the project API 9807696 failed
    Passed tests:
    Test Job Status Action
    Manage Project access token for a different project cannot be used to create a file via the project API 9807696 passed -
    Manage Project access token for a different project cannot be used to commit via the API 9807696 passed -
    Manage Project access token for the same project can be used to commit via the API 9807696 passed -
    Manage Project access token for the same project can be used to create a file via the project API 9807696 passed -
    Manage Group access token can be used to commit via the API 9807696 passed -
    Manage Group access tokens can be created and revoked via the UI 9807699 passed -
    Manage basic user login user logs in using basic credentials and logs out 9807699 passed -
    Manage Project access tokens can be created and revoked via the UI 9807699 passed -
    Other tests:
    Test Job Status Action
    Manage basic user remains logged in when redirected from canary to non-canary node 9807699 quarantine pending -
    Create Slack app integration when using Slash commands creates an issue 9807700 pending -
    Create Slack app integration when using Slash commands with gitlab issue comments on an issue 9807700 pending -
    Create Slack app integration when using Slash commands with gitlab issue closes an issue 9807700 pending -
    Create Slack app integration when using Slash commands with gitlab issue displays an issue 9807700 pending -
    Create Slack app integration when using Slash commands with gitlab issue with target project moves an issue 9807700 pending -

    Plan

    • Total 58 tests
    • Passed 56 tests
    • Failed 2 tests
    • 0 other tests (usually skipped)
    Test Job Status Action
    Plan Assign Iterations assigns a group iteration to an existing issue 9807702 failed
    Plan Group Iterations creates a group iteration automatically through an iteration cadence 9807702 failed
    Passed tests:
    Test Job Status Action
    Plan Issue closes via pushing a commit 9807696 passed -
    Plan Epics milestone dates API updates epic dates when deleting milestones 9807697 passed -
    Plan Epics milestone dates API updates epic dates when adding another issue 9807697 passed -
    Plan Epics milestone dates API updates epic dates when updating milestones 9807697 passed -
    Plan Epics milestone dates API updates epic dates when removing issue 9807697 passed -
    Plan Epics roadmap presents epic on roadmap 9807702 passed -
    Plan promote issue to epic promotes issue to epic 9807702 passed -
    Plan Group level issues analytics behaves like issues analytics page displays a graph 9807702 passed -
    Plan Project level issues analytics behaves like issues analytics page displays a graph 9807702 passed -
    Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 9807702 passed -
    Plan Configure issue board by label shows only issues that match the configured label 9807702 passed -
    Plan for project insights page behaves like default insights page displays issues and merge requests dashboards 9807702 passed -
    Plan for group insights page behaves like default insights page displays issues and merge requests dashboards 9807702 passed -
    Plan Configurable issue board renames the issue board 9807702 passed -
    Plan Contribution Analytics tests contributions 9807702 passed -
    Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 9807702 passed -
    Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 9807702 passed -
    Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 9807702 passed -
    Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 9807702 passed -
    Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 9807702 passed -
    Plan Group issue boards shows multiple group boards in the boards dropdown menu 9807702 passed -
    Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels 9807702 passed -
    Plan Group issue boards creates a group issue board via the GUI 9807702 passed -
    Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 9807702 passed -
    Plan Read-only board configuration shows board configuration to user without edit permission 9807702 passed -
    Plan Epics Management creates a confidential epic 9807702 passed -
    Plan Epics Management creates an epic 9807702 passed -
    Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 9807702 passed -
    Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 9807702 passed -
    Plan Epics Management Resources created via API Visit epic first comments on epic 9807702 passed -
    Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 9807702 passed -
    Plan Default issue templates uses default template when creating an issue 9807702 passed -
    Plan Multiple assignees per issue shows four assignees in the issues list 9807702 passed -
    Plan Burndown chart shows burndown chart on milestone page 9807702 passed -
    Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 9807701 passed -
    Plan Design Management user archives a design 9807701 passed -
    Plan Related issues relates and unrelates one issue to/from another 9807701 passed -
    Plan Group milestone creates a group milestone 9807701 passed -
    Plan mention mentions another user in an issue 9807701 passed -
    Plan issue suggestions shows issue suggestions when creating a new issue 9807701 passed -
    Plan Project milestone creates a project milestone 9807701 passed -
    Plan filter issue comments activities filters comments and activities in an issue 9807701 passed -
    Plan Issue board focus mode focuses on issue board 9807701 passed -
    Plan Custom issue templates creates an issue via custom template 9807701 passed -
    Plan Design Management user adds a design and modifies it 9807701 passed -
    Plan Issue creation creates an issue 9807701 passed -
    Plan Issue creation closes an issue 9807701 passed -
    Plan Issue creation when using attachments in comments comments on an issue with an attachment 9807701 passed -
    Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue 9807701 passed -
    Plan Milestones Group milestone behaves like milestone assigned to new issue is assigned to a new issue 9807701 passed -
    Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue 9807701 passed -
    Plan Milestones Project milestone behaves like milestone assigned to new issue is assigned to a new issue 9807701 passed -
    Plan Issues list successfully exports issues list as CSV 9807701 passed -
    Plan Issue comments comments on an issue and edits the comment 9807701 passed -
    Plan Design Management user adds a design and annotates it 9807701 passed -
    Plan Assignees update without refresh 9807701 passed -

    Create

    • Total 129 tests
    • Passed 122 tests
    • Failed 3 tests
    • 4 other tests (usually skipped)
    Test Job Status Action
    Create Merged merge request can be reverted 9807704 failed
    • failure issue exists or was created
    Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number 9807707 failed
    • failure issue exists or was created
    Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 9807705 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Create Create a new project from a template commits via the api 9807696 passed -
    Create API basics user creates a project with a file and deletes them afterwards 9807696 passed -
    Create API basics raw file access sets no-cache headers as expected 9807696 passed -
    Create Merge request push options sets labels 9807696 passed -
    Create Merge request push options when labels are set already removes them on subsequent push 9807696 passed -
    Create Merge request push options removes the source branch 9807696 passed -
    Create Merge request push options sets title and description 9807696 passed -
    Create Merge request push options sets merge when pipeline succeeds 9807696 passed -
    Create Merge request push options merges when pipeline succeeds 9807696 passed -
    Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different 9807696 passed -
    Create Merge request push options sets a target branch 9807696 passed -
    Create PostReceive idempotent pushes and creates a single push event three times 9807696 passed -
    Create Creating pages in group wikis when wiki has a home page adds a second page 9807709 passed -
    Create Creating pages in group wikis when wiki is empty creates a new page 9807709 passed -
    Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository 9807709 quarantine passed -
    Create Project templates when group level successfully imports the project using template 9807709 passed -
    Create batch comments in merge request user submits a diff review 9807709 passed -
    Create batch comments in merge request user submits a non-diff review 9807709 passed -
    Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 9807709 passed -
    Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 9807709 passed -
    Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges 9807709 passed -
    Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push 9807709 passed -
    Create Testing group wiki can delete a group wiki page 9807709 passed -
    Create Codeowners displays owners specified in CODEOWNERS file 9807709 passed -
    Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth 9807709 passed -
    Create Approval rules allows multiple approval rules with users and groups 9807709 passed -
    Create File Locking creates a merge request and fails to merge 9807709 passed -
    Create File Locking locks a file and unlocks in list 9807709 passed -
    Create File Locking checks file locked by other user to be disabled 9807709 passed -
    Create File Locking locks a file and tries to push as a second user 9807709 passed -
    Create File Locking locks a directory and tries to push as a second user 9807709 passed -
    Create Push Rules using non signed commits restricts users by email format 9807709 passed -
    Create Push Rules using non signed commits restricts removal of tag 9807709 passed -
    Create Push Rules using non signed commits restricts commit by message format 9807709 passed -
    Create Push Rules using non signed commits restricts files by name and size 9807709 passed -
    Create Push Rules using non signed commits restricts committing files with secrets 9807709 passed -
    Create Push Rules using non signed commits allows an unrestricted push 9807709 passed -
    Create Push Rules using non signed commits restricts branches by branch name 9807709 passed -
    Create Push Rules using signed commits restricts to signed commits 9807709 passed -
    Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users 9807709 passed -
    Create Push Rules with commits restricted to verified emails rejects unverified emails 9807709 passed -
    Create Codeowners merge request assigns code owners as approvers 9807709 passed -
    Create Default merge request templates uses default template when creating a merge request 9807709 passed -
    Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled 9807709 passed -
    Create Testing group wiki file upload by creating a formatted page with an image uploaded 9807709 passed -
    Create Testing project wiki file upload by creating a formatted page with an image uploaded 9807704 passed -
    Create Reverting a commit creates a merge request 9807704 passed -
    Create Sharing snippets when the snippet is public can be shared with not signed-in users 9807704 passed -
    Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 9807704 passed -
    Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly 9807704 passed -
    Create Git push over HTTP user using a personal access token pushes code to the repository 9807704 passed -
    Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI 9807704 passed -
    Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI 9807704 passed -
    Create SSH keys support user can add an SSH key 9807704 passed -
    Create SSH keys support after adding an ssh key can delete an ssh key 9807704 passed -
    Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly 9807704 passed -
    Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository 9807704 passed -
    Create Merge request creation from fork can merge source branch from fork into upstream repository 9807704 passed -
    Create File management user deletes a file via the Web 9807704 passed -
    Create SSH key support pushes multiple branches and tags together 9807704 passed -
    Create SSH key support pushes code to the repository via SSH 9807704 passed -
    Create Testing wiki content manipulation inside a project by manipulating content on the page 9807704 passed -
    Create Testing wiki content manipulation inside a project by manipulating content on the page using git push 9807704 passed -
    Create Git push over HTTP user pushes code to the repository 9807707 passed -
    Create Project Wiki with Wiki Page List has all expected links that work 9807707 passed -
    Create Project Wiki with Wiki Sidebar has all expected links that work 9807707 passed -
    Create Testing project wiki can delete a page 9807707 passed -
    Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number 9807707 passed -
    Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number 9807707 passed -
    Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number 9807707 passed -
    Create Create a new merge request creates a merge request with a milestone and label 9807707 passed -
    Create Create a new merge request creates a basic merge request 9807707 passed -
    Create A project wiki can change the directory path of a page 9807707 passed -
    Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository 9807707 passed -
    Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository 9807707 passed -
    Create Testing wiki content creation inside a project by adding a second page to the wiki 9807707 passed -
    Create Testing wiki content creation inside a project by adding a home page to the wiki using git push 9807707 passed -
    Create Testing wiki content creation inside a project by adding a home page to the wiki 9807707 passed -
    Create Testing wiki content creation inside a project by adding a second page to the wiki using git push 9807707 passed -
    Create Cherry picking a commit creates a merge request 9807707 passed -
    Create Merge request rebasing user rebases source branch of merge request 9807707 passed -
    Create File templates user adds .gitignore via file template Android 9807707 passed -
    Create File templates user adds Dockerfile via file template Python 9807707 passed -
    Create File templates user adds LICENSE via file template Mozilla Public License 2.0 9807707 passed -
    Create File templates user adds .gitlab-ci.yml via file template Julia 9807707 passed -
    Create Multiple file snippet creates a project snippet with multiple files 9807707 passed -
    Create Cherry picking from a merge request creates a merge request 9807707 passed -
    Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI 9807707 passed -
    Create Create a new merge request from the event notification after a push creates a merge request after a push via the API 9807707 passed -
    Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 9807707 passed -
    Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 9807707 passed -
    Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed 9807707 passed -
    Create Add a directory in Web IDE when a directory with the same name already exists throws an error 9807707 passed -
    Create Merge request squashing user squashes commits while merging 9807707 passed -
    Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet 9807705 passed -
    Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet 9807705 passed -
    Create Multiple file snippet creates a personal snippet with multiple files 9807705 passed -
    Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository 9807705 passed -
    Create Personal snippet creation user creates a personal snippet 9807705 passed -
    Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them 9807705 passed -
    Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them 9807705 passed -
    Create Project snippet creation user creates a project snippet 9807705 passed -
    Create Commit data user views raw commit diff 9807705 passed -
    Create Commit data user views raw email patch 9807705 passed -
    Create File management user creates a file via the Web 9807705 passed -
    Create Git clone over HTTP user performs a deep clone 9807705 passed -
    Create Git clone over HTTP user performs a shallow clone 9807705 passed -
    Create File management user edits a file via the Web 9807705 passed -
    Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 9807705 passed -
    Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 9807705 passed -
    Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 9807705 passed -
    Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch 9807705 passed -
    Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch 9807705 passed -
    Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file 9807705 passed -
    Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file 9807705 passed -
    Create with merge request suggestions applies a single suggestion with a custom message 9807705 passed -
    Create Download merge request patch and diff views the merge request patches 9807705 passed -
    Create Download merge request patch and diff views the merge request plain diff 9807705 passed -
    Create Merge request custom templates creates a merge request via custom template 9807705 passed -
    Create with merge request batch suggestions applies multiple suggestions 9807705 passed -
    Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI 9807705 passed -
    Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI 9807705 passed -
    Other tests:
    Test Job Status Action
    Create Pages creates a Pages website 9807710 quarantine pending -
    Create Merge requests when merging once behaves like merge when pipeline succeeds merges after pipeline succeeds 9807704 quarantine pending -
    Create Branch Rules Overview adds a new branch rule 9807704 quarantine pending -
    Create Source editor toolbar preview can preview markdown side-by-side while editing 9807705 pending -

    Verify

    • Total 54 tests
    • Passed 36 tests
    • Failed 14 tests
    • 4 other tests (usually skipped)
    Test Job Status Action
    Verify Pipelines for merged results and merge trains creates a pipeline with merged results 9807718 failed
    Verify Pipelines for merged results and merge trains merges via a merge train 9807718 failed
    Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined 9807717 failed
    • failure issue exists or was created
    Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message 9807717 failed
    • failure issue exists or was created
    Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family 9807717 failed
    • failure issue exists or was created
    Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family 9807717 failed
    • failure issue exists or was created
    Verify Pipeline with protected variable exposes variable on protected branch 9807713 failed
    Verify Pipeline with protected variable does not expose variable on unprotected branch 9807713 failed
    Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline 9807713 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition 9807696 passed -
    Verify Pipeline with project file variables can read file variable content with cat 9807696 passed -
    Verify Pipeline with project file variables does not expose file variable content with echo 9807696 passed -
    Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project 9807718 passed -
    Verify Multi-project pipelines creates a multi-project pipeline with artifact download 9807718 passed -
    Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 9807718 passed -
    Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 9807718 passed -
    Verify In merge trains new thread discussion does not drop MR 9807718 passed -
    Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page 9807717 passed -
    Verify when pipeline is blocked can still merge MR successfully 9807717 passed -
    Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly 9807717 passed -
    Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly 9807717 passed -
    Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly 9807717 passed -
    Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly 9807717 passed -
    Verify Run pipeline with web only rule can trigger pipeline 9807717 passed -
    Verify Endpoint Coverage spans r/w postgres web sidekiq git api 9807717 passed -
    Verify Pipeline editor can switch branches and target branch field updates accordingly 9807717 passed -
    Verify Include local config file paths with wildcard runs the pipeline with composed config 9807717 passed -
    Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value 9807717 passed -
    Verify Include multiple files from a project runs the pipeline with composed config 9807717 passed -
    Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 9807717 passed -
    Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 9807717 passed -
    Verify Pipeline with raw variables in YAML expands variables according to expand: true/false 9807717 passed -
    Verify Pipeline editor can create merge request 9807713 passed -
    Verify UI defined variable is not inheritable by default 9807713 passed -
    Verify UI defined variable is not inheritable when forward:pipeline_variables is false 9807713 passed -
    Verify Runner registration user registers a new project runner 9807713 passed -
    Verify Run pipeline with manual jobs does not leave any job in skipped state 9807713 passed -
    Verify Code coverage statistics creates an MR with code coverage statistics 9807713 passed -
    Verify Pipeline editor when CI has invalid syntax shows invalid validations 9807713 passed -
    Verify Pipeline editor when CI has valid syntax shows valid validations 9807713 passed -
    Verify UI defined variable is inheritable when forward:pipeline_variables is true 9807713 passed -
    Verify Update CI file with pipeline editor creates new pipeline and target branch 9807713 passed -
    Verify Group runner registration user registers a new group runner 9807713 passed -
    Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config 9807713 passed -
    Verify Trigger child pipeline with 'when:manual' can trigger bridge job 9807713 passed -
    Other tests:
    Test Job Status Action
    Verify Include multiple files from multiple projects when FF is on runs the pipeline with composed config 9807713 pending -
    Verify Include multiple files from multiple projects when FF is off runs the pipeline with composed config 9807713 pending -
    Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline 9807713 quarantine pending -
    Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline 9807713 quarantine pending -

    Package

    • Total 23 tests
    • Passed 3 tests
    • Failed 1 tests
    • 19 other tests (usually skipped)
    Test Job Status Action
    Package Composer Repository publishes a composer package and deletes it 9807728 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Package Generic Repository uploads a generic package and downloads it 9807728 passed -
    Package Conan Repository publishes, installs, and deletes a Conan package 9807721 quarantine passed -
    Package Terraform Module Registry publishes a module 9807724 passed -
    Other tests:
    Test Job Status Action
    Package Container Registry pushes, pulls image to the registry and deletes tag 9807696 pending -
    Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package 9807728 pending -
    Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package 9807728 pending -
    Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package 9807728 pending -
    Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates 9807728 pending -
    Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates 9807728 pending -
    Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven 9807721 pending -
    Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven 9807721 pending -
    Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven 9807721 pending -
    Package Dependency Proxy using docker:19.03.12 and a group deploy token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:18.09.9 and a personal access token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:18.09.9 and a group deploy token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:18.09.9 and a ci job token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:20.10 and a ci job token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:19.03.12 and a personal access token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:20.10 and a personal access token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:19.03.12 and a ci job token pulls an image using the dependency proxy 9807721 pending -
    Package Dependency Proxy using docker:20.10 and a group deploy token pulls an image using the dependency proxy 9807721 pending -
    Package RubyGems Repository publishes a Ruby gem 9807724 pending -

    Release

    • Total 6 tests
    • Passed 3 tests
    • Failed 3 tests
    • 0 other tests (usually skipped)
    Test Job Status Action
    Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines 9807734 failed
    • failure issue exists or was created
    Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines 9807734 failed
    Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines 9807734 failed
    Passed tests:
    Test Job Status Action
    Release Deploy key creation user adds a deploy key 9807734 passed -
    Release Deploy token creation user adds a deploy token 9807734 passed -
    Release Operations Dashboard has many pipelines with appropriate statuses 9807739 passed -

    Configure

    • Total 3 tests
    • Passed 2 tests
    • Failed 0 tests
    • 1 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Configure Kubernetes Agent deploys a K8s manifest file 9807697 passed -
    Configure Auto DevOps with a Kubernetes Agent runs auto devops 9807741 passed -
    Other tests:
    Test Job Status Action
    Configure AutoDevOps Templates using express template works with Auto DevOps 9807741 pending -

    Monitor

    • Total 10 tests
    • Passed 9 tests
    • Failed 1 tests
    • 0 other tests (usually skipped)
    Test Job Status Action
    Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident 9807743 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident 9807743 quarantine passed -
    Monitor Alert settings when using Prometheus integration behaves like sends test alert creates new alert 9807743 passed -
    Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert creates new alert 9807743 passed -
    Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert using authorization key creates new alert 9807743 passed -
    Monitor Alert settings when using Prometheus integration behaves like sends test alert using authorization key creates new alert 9807743 passed -
    Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident 9807743 passed -
    Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident 9807743 passed -
    Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only resolves the correct alert 9807743 quarantine passed -
    Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert 9807743 passed -

    Secure

    • Total 12 tests
    • Passed 3 tests
    • Failed 0 tests
    • 9 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Secure Enable Scanning from UI license compliance shows status in configuration shows correct status in configuration 9807751 passed -
    Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration 9807751 passed -
    Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration 9807751 passed -
    Other tests:
    Test Job Status Action
    Secure License Compliance has empty state 9807751 quarantine pending -
    Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like deny license can deny a license in the settings page 9807751 quarantine pending -
    Secure License Compliance when a CycloneDX SBOM file exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 9807751 quarantine pending -
    Secure License Compliance when a CycloneDX SBOM file exists License Management behaves like approve license can approve a license in the settings page 9807751 quarantine pending -
    Secure License Compliance when a license management report exists License Management behaves like deny license can deny a license in the settings page 9807751 quarantine pending -
    Secure License Compliance when a license management report exists License Management Pipeline Licence tab behaves like pipeline license display can approve and deny licenses in the pipeline 9807751 quarantine pending -
    Secure License Compliance when a license management report exists License Management behaves like approve license can approve a license in the settings page 9807751 quarantine pending -
    Secure License merge request widget when a license scanning report exists manage licenses from the merge request 9807751 pending -
    Secure License merge request widget when a CycloneDX SBOM file exists manage licenses from the merge request 9807751 pending -

    Data_stores

    • Total 14 tests
    • Passed 3 tests
    • Failed 0 tests
    • 11 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Data Stores Users API GET /users 9807696 passed -
    Data Stores Users API GET /users/:username with a valid username 9807696 passed -
    Data Stores Users API GET /users/:username with an invalid username 9807696 passed -
    Other tests:
    Test Job Status Action
    Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 9807698 pending -
    Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user 9807698 pending -
    Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user 9807698 pending -
    Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description 9807698 pending -
    Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name 9807698 pending -
    Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description 9807698 pending -
    Data Stores When using elasticsearch API to search for a public issue finds issue that matches description 9807698 pending -
    Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content 9807698 pending -
    Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user 9807698 pending -
    Data Stores When using elasticsearch API to search for a public note finds note that matches note body 9807698 pending -
    Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message 9807698 pending -

    Govern

    • Total 33 tests
    • Passed 23 tests
    • Failed 10 tests
    • 0 other tests (usually skipped)
    Test Job Status Action
    Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy 9807746 failed
    • failure issue exists or was created
    Govern Project vulnerability report validates "fix a vulnerability" workflow 9807746 failed
    • failure issue exists or was created
    Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab 9807746 failed
    • failure issue exists or was created
    Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget 9807746 failed
    • failure issue exists or was created
    Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget 9807746 failed
    • failure issue exists or was created
    Govern Security Reports displays false positives for the vulnerabilities 9807746 failed
    • failure issue exists or was created
    Govern Security Reports displays security reports in the group security dashboard 9807746 failed
    • failure issue exists or was created
    Govern Security Reports displays the Dependency List 9807746 failed
    • failure issue exists or was created
    Govern Security Reports displays security reports in the pipeline 9807746 failed
    • failure issue exists or was created
    Govern Security Reports dependency list has empty state 9807746 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Govern Group for update group name behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for add group behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for add and remove project access behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Policies List page can load Policies page and view the policies list 9807746 passed -
    Govern Policies List page can navigate to Policy Editor page 9807746 passed -
    Govern Security Dashboard in a Project creates an issue from vulnerability details 9807746 passed -
    Govern Security Dashboard in a Project shows vulnerability details 9807746 passed -
    Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab 9807746 passed -
    Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget 9807746 passed -
    Govern project vulnerability report can successfully bulk change status in vulnerability report 9807746 passed -
    Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page 9807746 passed -
    Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for change project creation level behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget 9807746 passed -
    Govern Project for add user access as guest behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Project for project archive and unarchive behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Project for add project behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Project for change visibility behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Project for add deploy key behaves like audit event logs audit events for UI operations 9807746 passed -
    Govern Security Reports displays security reports in the project security dashboard 9807746 passed -

    Link to Grafana dashboard for run-type of canary-full

    Designs

      Child items ...

      2. Activity

      Please register or sign in to reply