Reliable e2e test report

• Candidates for promotion to reliable (2023-10-09 - 2023-10-23)
  • analytics (2)
  • create (83)
  • data_stores (23)
  • fulfillment (2)
  • govern (25)
  • manage (2)
  • monitor (3)
  • package (27)
  • plan (23)
  • release (5)
  • secure (1)
  • verify (30)
• Reliable specs with failures (2023-10-09 - 2023-10-23)
  • create (6)
  • data_stores (6)
  • govern (6)
  • verify (3)

Candidates for promotion to reliable (2023-10-09 - 2023-10-23)

Total amount: 226

STAGE	COUNT
analytics	2
create	83
data_stores	23
fulfillment	2
govern	25
manage	2
monitor	3
package	27
plan	23
release	5
secure	1
verify	30

analytics (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled File: service_ping_default_enabled_spec.rb	22	0	0%
Name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests File: performance_bar_spec.rb	13	0	0%

create (83)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Create API basics raw file access sets no-cache headers as expected File: files_spec.rb	22	0	0%
Name: Create API basics user creates a project with a file and deletes them afterwards File: files_spec.rb	22	0	0%
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb	22	0	0%
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb	22	0	0%
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb	22	0	0%
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb	22	0	0%
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb	22	0	0%
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb	22	0	0%
Name: Create Codeowners displays owners specified in CODEOWNERS file File: code_owners_spec.rb	22	0	0%
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb	22	0	0%
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb	22	0	0%
Name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb	22	0	0%
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb	22	0	0%
Name: Create Create a new merge request creates a merge request with a milestone and label File: create_merge_request_spec.rb	22	0	0%
Name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches File: add_list_delete_branches_spec.rb	22	0	0%
Name: Create File Locking checks file locked by other user to be disabled File: file_locking_spec.rb	22	0	0%
Name: Create File Locking creates a merge request and fails to merge File: file_locking_spec.rb	22	0	0%
Name: Create File Locking locks a directory and tries to push as a second user File: file_locking_spec.rb	22	0	0%
Name: Create File Locking locks a file and tries to push as a second user File: file_locking_spec.rb	22	0	0%
Name: Create File Locking locks a file and unlocks in list File: file_locking_spec.rb	22	0	0%
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb	22	0	0%
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb	22	0	0%
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb	22	0	0%
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb	22	0	0%
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb	22	0	0%
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb	22	0	0%
Name: Create Git clone over HTTP user performs a deep clone File: clone_spec.rb	22	0	0%
Name: Create Git clone over HTTP user performs a shallow clone File: clone_spec.rb	22	0	0%
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb	22	0	0%
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb	22	0	0%
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb	22	0	0%
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb	22	0	0%
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb	22	0	0%
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb	22	0	0%
Name: Create Merge request rebasing user rebases source branch of merge request File: rebase_merge_request_spec.rb	22	0	0%
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb	22	0	0%
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb	22	0	0%
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb	22	0	0%
Name: Create PostReceive idempotent pushes and creates a single push event three times File: push_postreceive_idempotent_spec.rb	22	0	0%
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb	22	0	0%
Name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth File: pull_mirroring_over_http_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts commit by message format File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb	22	0	0%
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb	22	0	0%
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb	22	0	0%
Name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository File: push_mirroring_over_http_spec.rb	22	0	0%
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb	22	0	0%
Name: Create Push over SSH using Git protocol version 2 user pushes to the repository File: protocol_v2_push_ssh_spec.rb	22	0	0%
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb	22	0	0%
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb	22	0	0%
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb	22	0	0%
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb	22	0	0%
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb	22	0	0%
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb	22	0	0%
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb	22	0	0%
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb	22	0	0%
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number File: snippet_index_page_spec.rb	22	0	0%
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb	22	0	0%
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number File: snippet_index_page_spec.rb	22	0	0%
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb	22	0	0%
Name: Create Upload a file in Web IDE when a file with the same name already exists throws an error File: upload_new_file_in_web_ide_spec.rb	22	0	0%
Name: Create Upload a file in Web IDE when the file is a text file behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb	22	0	0%
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI File: clone_push_pull_personal_snippet_spec.rb	22	0	0%
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI File: clone_push_pull_personal_snippet_spec.rb	22	0	0%
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb	22	0	0%
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb	22	0	0%
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb	20	0	0%
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb	13	0	0%
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb	13	0	0%
Name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name File: default_branch_name_setting_spec.rb	13	0	0%
Name: Create Default branch name instance setting sets the default branch name for a new project File: default_branch_name_setting_spec.rb	13	0	0%
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb	13	0	0%
Name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository File: pull_mirroring_over_ssh_with_key_spec.rb	13	0	0%
Name: Create Repository Usage Quota matches cloned repo usage to reported usage File: storage_size_spec.rb	13	0	0%
Name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit File: push_over_http_file_size_spec.rb	13	0	0%
Name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit File: push_over_http_file_size_spec.rb	13	0	0%

data_stores (23)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb	113	0	0%
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description File: advanced_global_advanced_syntax_search_spec.rb	61	0	0%
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name File: advanced_global_advanced_syntax_search_spec.rb	61	0	0%
Name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message File: commit_index_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb	61	0	0%
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb	61	0	0%
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb	52	0	0%
Name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API File: user_inherited_access_spec.rb	22	0	0%
Name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API File: user_inherited_access_spec.rb	22	0	0%
Name: Data Stores Group member access request generates a todo item for the group owner File: group_member_access_request_spec.rb	13	0	0%
Name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group File: group_member_access_request_spec.rb	13	0	0%
Name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group File: group_member_access_request_spec.rb	13	0	0%
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb	13	0	0%
Name: Data Stores Subgroup transfer transfers a subgroup to another group File: transfer_group_spec.rb	13	0	0%
Name: Data Stores User can be followed and their activity seen File: follow_user_activity_spec.rb	13	0	0%
Name: Data Stores User when added to parent group is allowed to edit the sub-group project files File: user_inherited_access_spec.rb	13	0	0%
Name: Data Stores User when added to sub-group is not allowed to edit the parent group project files File: user_inherited_access_spec.rb	13	0	0%
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb	13	0	0%
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb	13	0	0%

fulfillment (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Fulfillment Active license details shows up in subscription page File: license_spec.rb	13	0	0%
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb	13	0	0%

govern (25)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned File: compliance_pipeline_spec.rb	22	0	0%
Name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations File: group_audit_logs_1_spec.rb	22	0	0%
Name: Govern MR security widget checks that dismissed vulnerabilities do not show up File: dismissed_vulnerabilities_in_security_widget_spec.rb	22	0	0%
Name: Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings File: scan_result_policy_vulnerabilities_spec.rb	22	0	0%
Name: Govern Security Reports dependency list has empty state File: security_reports_spec.rb	22	0	0%
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb	22	0	0%
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb	22	0	0%
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb	22	0	0%
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb	22	0	0%
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb	22	0	0%
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb	22	0	0%
Name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON File: vulnerability_security_training_spec.rb	22	0	0%
Name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget File: vulnerability_management_spec.rb	22	0	0%
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb	22	0	0%
Name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget File: vulnerability_management_spec.rb	22	0	0%
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb	22	0	0%
Name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event File: group_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event File: group_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event File: group_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Group audit event streaming with no destination adds a streaming destination File: group_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Instance audit event streaming when a group is created the external server receives the event File: instance_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Instance audit event streaming when a project is created the external server receives the event File: instance_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event File: instance_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Instance audit event streaming when a user is created the external server receives the event File: instance_audit_event_streaming_spec.rb	13	0	0%
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb	13	0	0%

manage (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb	13	0	0%
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb	13	0	0%

monitor (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb	22	0	0%
Name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb	22	0	0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb	22	0	0%

package (27)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Package Conan Repository publishes, installs, and deletes a Conan package File: conan_repository_spec.rb	22	0	0%
Name: Package Generic Repository uploads a generic package and downloads it File: generic_repository_spec.rb	22	0	0%
Name: Package Helm Registry using ci job token pushes and pulls a helm chart File: helm_registry_spec.rb	22	0	0%
Name: Package Helm Registry using personal access token pushes and pulls a helm chart File: helm_registry_spec.rb	22	0	0%
Name: Package Helm Registry using project deploy token pushes and pulls a helm chart File: helm_registry_spec.rb	22	0	0%
Name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb	22	0	0%
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb	22	0	0%
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb	22	0	0%
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb	22	0	0%
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates File: maven_group_level_spec.rb	22	0	0%
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package File: maven_group_level_spec.rb	22	0	0%
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package File: maven_group_level_spec.rb	22	0	0%
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package File: maven_group_level_spec.rb	22	0	0%
Name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven File: maven_project_level_spec.rb	22	0	0%
Name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven File: maven_project_level_spec.rb	22	0	0%
Name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven File: maven_project_level_spec.rb	22	0	0%
Name: Package PyPI Repository when at the project level publishes and installs a pypi package File: pypi_repository_spec.rb	22	0	0%
Name: Package RubyGems Repository publishes a Ruby gem File: rubygems_registry_spec.rb	22	0	0%
Name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI File: npm_group_level_spec.rb	22	0	0%
Name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI File: npm_group_level_spec.rb	22	0	0%
Name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI File: npm_group_level_spec.rb	22	0	0%
Name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI File: npm_instance_level_spec.rb	22	0	0%
Name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI File: npm_instance_level_spec.rb	22	0	0%
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI File: npm_instance_level_spec.rb	22	0	0%
Name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI File: npm_project_level_spec.rb	22	0	0%
Name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI File: npm_project_level_spec.rb	22	0	0%
Name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI File: npm_project_level_spec.rb	22	0	0%

plan (23)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Plan A project wiki can change the directory path of a page File: project_based_directory_management_spec.rb	22	0	0%
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb	22	0	0%
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb	22	0	0%
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb	22	0	0%
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb	22	0	0%
Name: Plan Design Management user adds a design and annotates it File: add_design_content_spec.rb	22	0	0%
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb	22	0	0%
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb	22	0	0%
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb	22	0	0%
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb	22	0	0%
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb	22	0	0%
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb	22	0	0%
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb	22	0	0%
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb	22	0	0%
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb	22	0	0%
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb	22	0	0%
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb	22	0	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb	22	0	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb	22	0	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb	22	0	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb	22	0	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb	22	0	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb	22	0	0%

release (5)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Release Deploy key creation user adds a deploy key File: add_deploy_key_spec.rb	22	0	0%
Name: Release Deploy token creation user adds a deploy token File: add_deploy_token_spec.rb	22	0	0%
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines File: clone_using_deploy_key_spec.rb	22	0	0%
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines File: clone_using_deploy_key_spec.rb	22	0	0%
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines File: clone_using_deploy_key_spec.rb	22	0	0%

secure (1)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration File: enable_scanning_from_configuration_spec.rb	22	0	0%

verify (30)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Include multiple files from a project runs the pipeline with composed config File: include_multiple_files_from_a_project_spec.rb	22	0	0%
Name: Verify Job artifacts are not downloaded when dependencies array is set to empty File: job_downloads_artifacts_spec.rb	22	0	0%
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb	22	0	0%
Name: Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message File: pipeline_with_image_pull_policy_spec.rb	22	0	0%
Name: Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined File: prefill_variables_spec.rb	22	0	0%
Name: Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page File: prefill_variables_spec.rb	22	0	0%
Name: Verify Pipeline with project file variables can read file variable content with cat File: file_variable_spec.rb	22	0	0%
Name: Verify Pipeline with project file variables does not expose file variable content with echo File: file_variable_spec.rb	22	0	0%
Name: Verify Pipeline with protected variable does not expose variable on unprotected branch File: pipeline_with_protected_variable_spec.rb	22	0	0%
Name: Verify Pipeline with protected variable exposes variable on protected branch File: pipeline_with_protected_variable_spec.rb	22	0	0%
Name: Verify Pipeline with raw variables in YAML expands variables according to expand: true/false File: raw_variables_defined_in_yaml_spec.rb	22	0	0%
Name: Verify Project artifacts when user tries bulk deletion successfully delete them File: user_can_bulk_delete_artifacts_spec.rb	22	0	0%
Name: Verify Run pipeline with manual jobs does not leave any job in skipped state File: run_pipeline_with_manual_jobs_spec.rb	22	0	0%
Name: Verify Runner fleet management shows group runner counts File: group_runner_counts_spec.rb	22	0	0%
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb	22	0	0%
Name: Verify Runner registration user registers a new project runner File: register_runner_spec.rb	22	0	0%
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb	22	0	0%
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb	22	0	0%
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb	22	0	0%
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb	22	0	0%
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	22	0	0%
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb	22	0	0%
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb	22	0	0%
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb	22	0	0%

Reliable specs with failures (2023-10-09 - 2023-10-23)

Total amount: 21

STAGE	COUNT
create	6
data_stores	6
govern	6
verify	3

create (6)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Create Cherry picking from a merge request creates a merge request File: cherry_pick_a_merge_spec.rb Exceptions: - Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"	354	1	0.28%
Name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push File: push_protected_branch_spec.rb Exceptions: - expected QA::Support::Run::CommandError with message matching /You are not allowed to push code to protected branches on this project\.([\s\S]+)\[remote rejected\] protected-branch -> protected-branch \(pre-receive hook declined\)/ but nothing was...	354	1	0.28%
Name: Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user File: protected_tags_spec.rb Exceptions: - Unable to find css "[data-testid=\"new_tag_button\"],[data-qa-selector=\"new_tag_button\"]"	354	1	0.28%
Name: Create Reverting a commit creates a merge request File: revert_commit_spec.rb Exceptions: - Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"	354	1	0.28%
Name: Create new merge request from the event notification after a push via the API creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Wait failed after 60 seconds	354	1	0.28%
Name: Create new merge request from the event notification after a push via the git CLI creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Wait failed after 60 seconds	354	1	0.28%

data_stores (6)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Data Stores User when added to parent group is allowed to push code to sub-group project via the CLI File: user_inherited_access_spec.rb Exceptions: - expected no Exception, got #<QA::Support::Run::CommandError: The command HOME="/tmp/qa-netrc-credentials/27" git push https://qa...ub-groupd-project-to-test-user-access-8b74dd46a930a54f.git/': The requested URL returned error: 403> with backtrace:... - expected no Exception, got #<QA::Support::Run::CommandError: The command HOME="/tmp/qa-netrc-credentials/27" git push https://qa...ub-groupd-project-to-test-user-access-f3979aeecc6932a6.git/': The requested URL returned error: 403> with backtrace:... - expected no Exception, got #<QA::Support::Run::CommandError: The command HOME="/tmp/qa-netrc-credentials/27" git push https://qa...ub-groupd-project-to-test-user-access-ec099e6de7d9c7cd.git/': The requested URL returned error: 403> with backtrace:...	223	3	1.35%
Name: Data Stores Project owner permissions for group projects behaves like adds user as maintainer has maintainer role without owner permissions File: project_owner_permissions_spec.rb Exceptions: - Unable to find css "[data-testid=\"api_label\"],[data-qa-selector=\"api_label\"]"	345	1	0.29%
Name: Data Stores Project owner permissions for group projects behaves like adds user as owner has owner role and permissions File: project_owner_permissions_spec.rb Exceptions: - Unable to find css "[data-testid=\"api_label\"],[data-qa-selector=\"api_label\"]"	345	1	0.29%
Name: Data Stores Project owner permissions for personal projects behaves like adds user as maintainer has maintainer role without owner permissions File: project_owner_permissions_spec.rb Exceptions: - Unable to find css "[data-testid=\"api_label\"],[data-qa-selector=\"api_label\"]"	345	1	0.29%
Name: Data Stores Project owner permissions for personal projects behaves like adds user as owner has owner role and permissions File: project_owner_permissions_spec.rb Exceptions: - Unable to find css "[data-testid=\"api_label\"],[data-qa-selector=\"api_label\"]"	345	1	0.29%
Name: Data Stores Project transfer user transfers a project between groups File: transfer_project_spec.rb Exceptions: - expected 'QA::Page::Project::Show.has_readme_content?("Here is the edited content.")' to be truthy, got false	345	1	0.29%

govern (6)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Govern compliance dashboard with separation of duties in an MR when there are two approvals but one of the approvers is the author shows only "author approved merge request" and "approved by committer" violations File: group_compliance_dashboard_spec.rb Exceptions: - expected QA::EE::Page::Group::Compliance::Show not to have violation "Less than 2 approvers" and "compliance-dashboard-mr-4a9f373b038f"	13	1	7.69%
Name: Govern compliance dashboard with separation of duties in an MR when there is only one approval from a user other than the author shows only "less than two approvers" violation File: group_compliance_dashboard_spec.rb Exceptions: - expected QA::EE::Page::Group::Compliance::Show to have violation "Less than 2 approvers" and "compliance-dashboard-mr-72063db74533"	13	1	7.69%
Name: Govern Group for add group behaves like audit event logs audit events for UI operations File: group_audit_logs_1_spec.rb Exceptions: - Fabrication of QA::Resource::Sandbox using the API failed (400) with '{"message":"Failed to save group {:path=>[\"has already been taken\"]}"}'.Correlation Id: 9ca4986762a32188c1f0c4bcdaf7f0d2Sentry Url: https://new-sentry.gitlab.net/organizations...	354	1	0.28%
Name: Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations File: group_audit_logs_1_spec.rb Exceptions: - Unable to find css "[data-testid=\"search_bar_input\"],[data-qa-selector=\"search_bar_input\"]"	354	1	0.28%
Name: Govern Project for add project behaves like audit event logs audit events for UI operations File: project_audit_logs_spec.rb Exceptions: - Unable to find css "[data-testid=\"project_id_content\"],[data-qa-selector=\"project_id_content\"]"	354	1	0.28%
Name: Govern project vulnerability report can bulk dismiss vulnerabilities as false positive in vulnerability report File: change_vulnerability_status_spec.rb Exceptions: - Fabrication of QA::EE::Resource::VulnerabilityItem using the API failed (200) with '{"data":{"vulnerabilityCreate":null},"errors":[{"message":"The resource that you are attempting to access does not exist or you don't have permission to perform th...	354	1	0.28%

verify (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes File: parent_child_pipelines_dependent_relationship_spec.rb Exceptions: - Waiting for linked pipeline to appear failed after 3 attempts	354	1	0.28%
Name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results File: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Wait failed after 120 seconds	354	1	0.28%
Name: Verify Pipelines for merged results and merge trains merges via a merge train File: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Wait failed after 120 seconds	354	1	0.28%