Reliable e2e test report
- Candidates for promotion to reliable (2023-12-04 - 2023-12-18)
- Reliable specs with failures (2023-12-04 - 2023-12-18)
Candidates for promotion to reliable (2023-12-04 - 2023-12-18)
Total amount: 189
STAGE | COUNT |
---|---|
create | 75 |
data_stores | 21 |
fulfillment | 2 |
govern | 21 |
manage | 2 |
package | 28 |
plan | 23 |
secure | 2 |
verify | 15 |
Create (75)
Executions table groupsource code (63)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create API basics user creates a project with a file and deletes them afterwards File: files_spec.rb |
20 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb |
20 | 0 | 0% |
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
20 | 0 | 0% |
Name: Create Create a new project from a template commits via the api File: commit_to_templated_project_spec.rb |
20 | 0 | 0% |
Name: Create File Locking locks a directory and tries to push as a second user File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File Locking locks a file and unlocks in list File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create PostReceive idempotent pushes and creates a single push event three times File: push_postreceive_idempotent_spec.rb |
20 | 0 | 0% |
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when built-in successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when group level successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when instance level successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth File: pull_mirroring_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository File: pull_mirroring_over_ssh_with_key_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts commit by message format File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository File: push_mirroring_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb |
20 | 0 | 0% |
Name: Create Push over SSH using Git protocol version 2 user pushes to the repository File: protocol_v2_push_ssh_spec.rb |
20 | 0 | 0% |
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
20 | 0 | 0% |
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb |
20 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI File: clone_push_pull_personal_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI File: clone_push_pull_personal_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb |
13 | 0 | 0% |
Executions table groupide (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Closing Web IDE shows an alert when there are unsaved changes File: closing_web_ide_with_unsaved_changes_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when a file with the same name already exists throws an error File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is a text file behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is an image behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Executions table groupcode review (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb |
20 | 0 | 0% |
Name: Create Create a new merge request creates a merge request with a milestone and label File: create_merge_request_spec.rb |
20 | 0 | 0% |
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb |
20 | 0 | 0% |
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb |
20 | 0 | 0% |
Name: Create Merge request rebasing user rebases source branch of merge request File: rebase_merge_request_spec.rb |
20 | 0 | 0% |
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb |
20 | 0 | 0% |
Data_stores (21)
Executions table grouptenant scale (11)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API File: user_inherited_access_spec.rb |
20 | 0 | 0% |
Name: Data Stores Group member access request generates a todo item for the group owner File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores Subgroup transfer transfers a subgroup to another group File: transfer_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores User can be followed and their activity seen File: follow_user_activity_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to parent group is allowed to edit the sub-group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to edit the parent group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Executions table groupglobal search (10)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb |
111 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after push File: elasticsearch_reindexing_spec.rb |
52 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after webIDE File: elasticsearch_reindexing_spec.rb |
52 | 0 | 0% |
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb |
52 | 0 | 0% |
Fulfillment (2)
Executions table groupprovision (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Active license details shows up in subscription page File: license_spec.rb |
13 | 0 | 0% |
Executions table groupsubscription management (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb |
13 | 0 | 0% |
Govern (21)
Executions table groupcompliance (7)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned File: compliance_pipeline_spec.rb |
20 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with no destination adds a streaming destination File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a group is created the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Executions table groupauthentication (5)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Project access token for the same project can be used to commit via the API File: project_access_token_spec.rb |
20 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to push code via the CLI File: minimal_access_user_spec.rb |
20 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to commit via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI File: user_access_termination_spec.rb |
13 | 0 | 0% |
Executions table groupthreat insights (9)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON File: vulnerability_security_training_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb |
13 | 0 | 0% |
Manage (2)
Executions table groupimport and integrate (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb |
13 | 0 | 0% |
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb |
13 | 0 | 0% |
Package (28)
Executions table grouppackage registry (28)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a ci job token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a personal access token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a project deploy token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package RubyGems Repository publishes a Ruby gem File: rubygems_registry_spec.rb |
20 | 0 | 0% |
Name: Package Terraform Module Registry publishes a module File: terraform_module_registry_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Plan (23)
Executions table groupknowledge (13)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan A project wiki can change the directory path of a page File: project_based_directory_management_spec.rb |
20 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb |
20 | 0 | 0% |
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb |
20 | 0 | 0% |
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb |
20 | 0 | 0% |
Executions table groupproject management (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb |
20 | 0 | 0% |
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb |
20 | 0 | 0% |
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb |
20 | 0 | 0% |
Executions table groupproduct planning (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Design Management user adds a design and annotates it File: add_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb |
20 | 0 | 0% |
Secure (2)
Executions table groupstatic analysis (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
20 | 0 | 0% |
Name: Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
20 | 0 | 0% |
Verify (15)
Executions table grouprunner (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Group runner registration user registers a new group runner File: register_group_runner_spec.rb |
20 | 0 | 0% |
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb |
20 | 0 | 0% |
Name: Verify Runner registration user registers a new project runner File: register_runner_spec.rb |
20 | 0 | 0% |
Executions table grouppipeline security (8)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb |
20 | 0 | 0% |
Name: Verify Project artifacts when user tries bulk deletion successfully delete them File: user_can_bulk_delete_artifacts_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb Exceptions: - Fabrication of QA::Resource::Project using the API failed (502) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1, maximum-scale=1" name="viewport"> <title>500 Error - GitLab</title> <style>body{align-items:ce...
|
20 | 0 | 0% |
Executions table grouppipeline execution (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb |
20 | 0 | 0% |
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb |
20 | 0 | 0% |
Executions table grouppipeline authoring (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb |
20 | 0 | 0% |
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb |
20 | 0 | 0% |
Reliable specs with failures (2023-12-04 - 2023-12-18)
Total amount: 61
STAGE | COUNT |
---|---|
create | 6 |
data_stores | 6 |
govern | 19 |
monitor | 3 |
plan | 12 |
verify | 15 |
Create (6)
Executions table groupsource code (5)
Executions table groupcode review (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create new merge request from the event notification after a push via the API creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Fabrication of QA::Resource::Sandbox using the API failed (400) with '{"message":"Failed to save group {:path=>[\"has already been taken\"]}"}'.Correlation Id: 7659169fc0d6dd58686d4d08f656d0f6Sentry Url: https://new-sentry.gitlab.net/organizations... - Wait failed after 60 seconds
|
336 | 4 | 1.19% |
Data_stores (6)
Executions table grouptenant scale (6)
Govern (19)
Executions table groupauthentication (1)
Executions table groupcompliance (9)
Executions table groupsecurity policies (3)
Executions table groupthreat insights (6)
Monitor (3)
Executions table grouprespond (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb Exceptions: - expected QA::Page::Project::Monitor::Alerts::Index to have alert with title "Et ut corrupti est." - RSpec::Expectations::MultipleExpectationsNotMetError
|
336 | 2 | 0.6% |
Name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb Exceptions: - Wait failed after 60 seconds
|
337 | 2 | 0.59% |
Name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb Exceptions: - Wait failed after 60 seconds
|
337 | 2 | 0.59% |
Plan (12)
Executions table groupproject management (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Project milestone creates a project milestone File: create_project_milestone_spec.rb Exceptions: - element not interactable: element has zero size (Session info: headless chrome=113.0.5672.126)
|
337 | 4 | 1.19% |
Name: Plan Custom email customizes email with additional text File: custom_email_spec.rb Exceptions: - Wait failed after 60 seconds
|
208 | 2 | 0.96% |
Executions table groupoptimize (3)
Executions table groupproduct planning (6)
Executions table groupknowledge (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Testing project wiki file upload by creating a formatted page with an image uploaded File: project_based_file_upload_spec.rb Exceptions: - Unable to find css "[data-testid=\"wiki-title-textbox\"],[data-qa-selector=\"wiki-title-textbox\"]"
|
325 | 1 | 0.31% |
Verify (15)
Executions table grouppipeline security (7)
Executions table grouppipeline authoring (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Include multiple files from multiple projects runs the pipeline with composed config File: include_multiple_files_from_multiple_projects_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
337 | 1 | 0.3% |
Name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
337 | 1 | 0.3% |
Name: Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
337 | 1 | 0.3% |
Executions table grouppipeline execution (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project File: pipeline_subscription_with_group_owned_project_spec.rb Exceptions: - Wait failed after 60 seconds - There are currently 1 pipelines in downstream project.
|
338 | 5 | 1.48% |
Name: Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails File: parent_child_pipelines_independent_relationship_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
336 | 1 | 0.3% |
Name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results File: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Timed out waiting for MR with id '1' to be prepared.
|
337 | 1 | 0.3% |
Name: Verify Run pipeline with manual jobs does not leave any job in skipped state File: run_pipeline_with_manual_jobs_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
338 | 1 | 0.3% |
Executions table grouprunner (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Runner fleet management shows group runner counts File: group_runner_counts_spec.rb Exceptions: - Unable to find css "[data-testid=\"runner-count-group\"],[data-qa-selector=\"runner-count-group\"]"
|
337 | 2 | 0.59% |