Reliable e2e test report

• Candidates for promotion to reliable (2022-03-14 - 2022-03-28)
  • create (78)
  • configure (2)
  • manage (67)
  • unknown (1)
  • enablement (10)
  • fulfillment (10)
  • non_devops (3)
  • package (29)
  • plan (18)
  • protect (3)
  • release (2)
  • verify (9)
• Reliable specs with failures (2022-03-14 - 2022-03-28)
  • package (6)
  • plan (8)
  • release (3)
  • verify (2)

Candidates for promotion to reliable (2022-03-14 - 2022-03-28)

Total amount: 232

STAGE	COUNT
create	78
configure	2
manage	67
unknown	1
enablement	10
fulfillment	10
non_devops	3
package	29
plan	18
protect	3
release	2
verify	9

create (78)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Git push over HTTP user pushes code to the repository file: push_over_http_spec.rb	1459	0	0%
name: SSH keys support after adding an ssh key can delete an ssh key file: ssh_key_support_spec.rb	1458	0	0%
name: SSH keys support user can add an SSH key file: ssh_key_support_spec.rb	1458	0	0%
name: Create SSH key support pushes code to the repository via SSH file: push_over_ssh_spec.rb	1457	0	0%
name: Create SSH key support pushes multiple branches and tags together file: push_over_ssh_spec.rb	1457	0	0%
name: Create Download merge request patch and diff views the merge request email patches file: view_merge_request_diff_patch_spec.rb	1336	0	0%
name: Create Download merge request patch and diff views the merge request plain diff file: view_merge_request_diff_patch_spec.rb	1336	0	0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet file: add_comment_to_snippet_spec.rb	1120	0	0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet file: add_comment_to_snippet_spec.rb	1120	0	0%
name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly file: branch_with_unusual_name_spec.rb	1120	0	0%
name: Create File management user deletes a file via the Web file: delete_file_via_web_spec.rb	1116	0	0%
name: Create Upload a file in Web IDE when a file with the same name already exists throws an error file: upload_new_file_in_web_ide_spec.rb	1116	0	0%
name: Create Upload a file in Web IDE when the file is a text file shows the Edit tab with the text file: upload_new_file_in_web_ide_spec.rb	1116	0	0%
name: Create Upload a file in Web IDE when the file is an image shows an image viewer file: upload_new_file_in_web_ide_spec.rb	1116	0	0%
name: Create Upload a file in Web IDE when the file is binary shows a Download button file: upload_new_file_in_web_ide_spec.rb	1116	0	0%
name: Create Project snippet creation user creates a project snippet file: create_project_snippet_spec.rb	1115	0	0%
name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository file: push_mirroring_over_http_spec.rb	1115	0	0%
name: Create Wiki has changed the directory file: project_based_directory_management_spec.rb	1115	0	0%
name: Create Merge request squashing user squashes commits while merging file: squash_merge_request_spec.rb	1114	0	0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file file: add_file_to_snippet_spec.rb	1114	0	0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file file: add_file_to_snippet_spec.rb	1114	0	0%
name: Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown file: share_snippet_spec.rb	1114	0	0%
name: Create Sharing snippets when the snippet is public can be shared with not signed-in users file: share_snippet_spec.rb	1114	0	0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number file: snippet_index_page_spec.rb	1114	0	0%
name: Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different file: project_archive_compare_spec.rb	1113	0	0%
name: Create Git clone over HTTP user performs a deep clone file: clone_spec.rb	1113	0	0%
name: Create Git clone over HTTP user performs a shallow clone file: clone_spec.rb	1113	0	0%
name: Create Review a merge request in Web IDE opens and edits a merge request in Web IDE file: review_merge_request_spec.rb	1113	0	0%
name: API basics raw file access sets no-cache headers as expected file: files_spec.rb	1112	0	0%
name: API basics user creates a project with a file and deletes them afterwards file: files_spec.rb	1112	0	0%
name: Create Cherry picking a commit creates a merge request file: cherry_pick_commit_spec.rb	1112	0	0%
name: Create Merge request push options when labels are set already removes them on subsequent push file: push_options_labels_spec.rb	1112	0	0%
name: Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch file: push_protected_branch_spec.rb	1112	0	0%
name: Create Add batch suggestions to a Merge Request applies multiple suggestions file: batch_suggestion_spec.rb	1111	0	0%
name: Create Design Management user adds a design and modifies it file: modify_design_content_spec.rb	1111	0	0%
name: Create Multiple file snippet creates a personal snippet with multiple files file: create_personal_snippet_with_multiple_files_spec.rb	1111	0	0%
name: Create Cherry picking from a merge request creates a merge request file: cherry_pick_a_merge_spec.rb	1109	0	0%
name: Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file file: delete_file_from_snippet_spec.rb	1109	0	0%
name: Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file file: delete_file_from_snippet_spec.rb	1109	0	0%
name: Create Wiki testing wiki content manipulation inside a project by manipulating content on the page file: project_based_content_manipulation_spec.rb	1108	0	0%
name: Create Wiki testing wiki content manipulation inside a project by manipulating content on the page using git push file: project_based_content_manipulation_spec.rb	1108	0	0%
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly file: file_with_unusual_name_spec.rb	1107	0	0%
name: Create Push over SSH using Git protocol version 2 user pushes to the repository file: protocol_v2_push_ssh_spec.rb	1102	0	0%
name: Create Push over HTTP using Git protocol version 2 user pushes to the repository file: protocol_v2_push_http_spec.rb	1101	0	0%
name: Create Create, list, and delete branches via web lists branches correctly after CRUD operations file: add_list_delete_branches_spec.rb	1048	0	0%
name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name file: default_branch_name_setting_spec.rb	1035	0	0%
name: Create Default branch name instance setting sets the default branch name for a new project file: default_branch_name_setting_spec.rb	1035	0	0%
name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth file: pull_mirroring_over_http_spec.rb	990	0	0%
name: Create Push Rules using non signed commits allows an unrestricted push file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using non signed commits restricts branches by branch name file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using non signed commits restricts commit by message format file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using non signed commits restricts committing files with secrets file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using non signed commits restricts files by name and size file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using non signed commits restricts removal of tag file: push_rules_spec.rb	990	0	0%
name: Create Push Rules using signed commits restricts to signed commits file: push_rules_spec.rb	990	0	0%
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users file: push_rules_spec.rb	990	0	0%
name: Create Push Rules with commits restricted to verified emails rejects unverified emails file: push_rules_spec.rb	990	0	0%
name: Create Contribution Analytics tests contributions file: contribution_analytics_spec.rb	988	0	0%
name: Create Codeowners merge request assigns code owners as approvers file: assign_code_owners_spec.rb	987	0	0%
name: Create batch comments in merge request user submits a diff review file: add_batch_comments_in_merge_request_spec.rb	987	0	0%
name: Create Wiki Creating pages in Group Wikis when Wiki has a home page adds a second page file: create_group_wiki_page_spec.rb	984	0	0%
name: Create Wiki Creating pages in Group Wikis when Wiki is empty creates a home page file: create_group_wiki_page_spec.rb	984	0	0%
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb	975	0	0%
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled file: code_owners_with_protected_branch_and_squashed_commits_spec.rb	931	0	0%
name: Create Git push over HTTP pushes to a project using a specific Praefect repository storage file: push_over_http_spec.rb	308	0	0%
name: Create Gitaly Using mTLS pushes to gitaly file: gitaly_mtls_spec.rb	226	0	0%
name: Create Changing Gitaly repository storage when moving from one Gitaly storage to another behaves like repository storage move confirms a finished status after moving project repository storage file: changing_repository_storage_spec.rb	224	0	0%
name: Create Gitaly repository storage creates a 2nd fork after moving the parent project file: move_project_create_fork_spec.rb	224	0	0%
name: Create Snippet repository storage moves snippet repository from one Gitaly storage to another file: snippet_repository_storage_move_spec.rb	224	0	0%
name: Create Jira integration closes an issue via a merge request file: jira_basic_integration_spec.rb	223	0	0%
name: Create Jira integration closes an issue via pushing a commit file: jira_basic_integration_spec.rb	223	0	0%
name: Create Gitaly Backend node recovery recovers from dataloss file: backend_node_recovery_spec.rb	221	0	0%
name: Create Gitaly Distributed reads reads from each node file: distributed_reads_spec.rb	221	0	0%
name: Create Gitaly Distributed reads when a node is unhealthy does not read from the unhealthy node file: distributed_reads_spec.rb	221	0	0%
name: Create Gitaly Cluster replication queue allows replication of different repository after interruption file: praefect_replication_queue_spec.rb	219	0	0%
name: Create Group Wiki repository storage moves group Wiki repository from one Gitaly storage to another file: group_wiki_repository_storage_move_spec.rb	213	0	0%
name: Create Git push to canary Gitaly node over HTTP pushes to a project using a canary specific Gitaly repository storage file: push_to_canary_gitaly_spec.rb	88	0	0%
name: Create PostReceive idempotent repeatedly pushes and creates a single push event several times file: push_postreceive_idempotent_spec.rb	56	0	0%

configure (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Configure AutoDevOps Templates using express template works with Auto DevOps file: auto_devops_templates_spec.rb	20	0	0%
name: Configure Auto DevOps support when rbac is enabled runs auto devops file: create_project_with_auto_devops_spec.rb	19	0	0%

manage (67)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Manage Project in group behaves like successful project creation creates a new project file: create_project_spec.rb	1458	0	0%
name: Manage Project in personal namespace behaves like successful project creation creates a new project file: create_project_spec.rb	1458	0	0%
name: Manage Project access token for the same project can be used to commit via the API file: project_access_token_spec.rb	1110	0	0%
name: Manage Create project badge creates project badge successfully file: create_project_badge_spec.rb	1103	0	0%
name: Manage Personal project permissions when user is added as Maintainer has Maintainer role without Owner permissions file: personal_project_permissions_spec.rb	1097	0	0%
name: Manage Personal project permissions when user is added as Owner has Owner role with Owner permissions file: personal_project_permissions_spec.rb	1097	0	0%
name: Manage User after parent group membership termination is not allowed to commit via the API file: user_access_termination_spec.rb	1055	0	0%
name: Manage User after parent group membership termination is not allowed to push code via the CLI file: user_access_termination_spec.rb	1055	0	0%
name: Manage User can be followed and their activity seen file: follow_user_activity_spec.rb	1049	0	0%
name: Manage 2FA allows 2FA code recovery via ssh file: 2fa_ssh_recovery_spec.rb	1039	0	0%
name: Manage 2FA allows using 2FA recovery code once only file: 2fa_recovery_spec.rb	1036	0	0%
name: Manage standard when admin approval is required allows user login after approval file: register_spec.rb	1034	0	0%
name: Manage 2FA allows enforcing 2FA via UI and logging in with 2FA file: log_in_with_2fa_spec.rb	1032	0	0%
name: Manage standard when admin approval is not required behaves like registration and login allows the user to registers and login file: register_spec.rb	1030	0	0%
name: Manage standard when admin approval is not required when user account is deleted allows recreating with same credentials file: register_spec.rb	1030	0	0%
name: Manage Gitlab migration with project member member retains direct membership in imported project file: gitlab_migration_members_spec.rb	1029	0	0%
name: Manage Gitlab migration with group member member retains indirect membership in imported project file: gitlab_migration_members_spec.rb	1028	0	0%
name: Manage Gitlab migration with project issues successfully imports issue file: gitlab_migration_issue_spec.rb	1026	0	0%
name: Manage Gitlab migration with repository successfully imports repository file: gitlab_migration_project_spec.rb	1022	0	0%
name: Manage Gitlab migration with uninitialized project successfully imports project file: gitlab_migration_project_spec.rb	1022	0	0%
name: Manage Gitlab migration with wiki successfully imports project wiki file: gitlab_migration_project_spec.rb	1022	0	0%
name: Manage rate limits throttles authenticated api requests by user file: rate_limits_spec.rb	1022	0	0%
name: Manage Gitlab migration with ci pipeline successfully imports ci pipeline file: gitlab_migration_pipeline_spec.rb	1017	0	0%
name: Manage Project Add project behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	992	0	0%
name: Manage Project Add user access as guest behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	992	0	0%
name: Manage Project Change visibility behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	992	0	0%
name: Manage Project Project archive and unarchive behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	992	0	0%
name: Manage Group Change project creation level behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	991	0	0%
name: Manage Group Disable and Enable LFS behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	991	0	0%
name: Manage Group Enable and disable allow user request access behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	991	0	0%
name: Manage Group Enable and disable membership lock behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	991	0	0%
name: Manage User with minimal access to group is not allowed to edit files via the UI file: minimal_access_user_spec.rb	930	0	0%
name: Manage Group Change repository size limit behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb	928	0	0%
name: Manage Gitlab migration imports group epics and iterations file: gitlab_migration_group_spec.rb	926	0	0%
name: Manage Project templates built-in successfully imports the project using template file: project_templates_spec.rb	924	0	0%
name: Manage User with minimal access to group is not allowed to commit via the API file: minimal_access_user_spec.rb	924	0	0%
name: Manage User with minimal access to group is not allowed to create a file via the API file: minimal_access_user_spec.rb	924	0	0%
name: Manage User with minimal access to group is not allowed to push code via the CLI file: minimal_access_user_spec.rb	924	0	0%
name: Manage Group file templates creates file via custom .gitignore file template file: group_file_template_spec.rb	921	0	0%
name: Manage Group file templates creates file via custom .gitlab-ci.yml file template file: group_file_template_spec.rb	921	0	0%
name: Manage Group file templates creates file via custom Dockerfile file template file: group_file_template_spec.rb	921	0	0%
name: Manage Group file templates creates file via custom LICENSE file template file: group_file_template_spec.rb	921	0	0%
name: Manage Project Export file download behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	913	0	0%
name: Manage Group Enable and disable 2FA requirement behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	912	0	0%
name: Manage Instance Add SSH key behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Instance Add and delete email behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Instance Change password behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Instance Failed sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Instance Start and stop user impersonation behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Instance Successful sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	911	0	0%
name: Manage Group access when restricted by another ip address via the API denies access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage Group access when restricted by another ip address via the SSH denies access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage Group access when restricted by another ip address via the UI denies access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage Group access when restricted by user's ip address via the API allows access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage Group access when restricted by user's ip address via the SSH allows access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage Group access when restricted by user's ip address via the UI allows access file: restrict_by_ip_address_spec.rb	903	0	0%
name: Manage LDAP login user logs into GitLab using LDAP credentials file: log_into_gitlab_via_ldap_spec.rb	449	0	0%
name: Manage LDAP Group sync user filter method has LDAP users synced file: group_ldap_sync_spec.rb	426	0	0%
name: Manage LDAP Group sync using group cn method has LDAP users synced file: group_ldap_sync_spec.rb	426	0	0%
name: Manage while LDAP is enabled behaves like registration and login allows the user to registers and login file: register_spec.rb	224	0	0%
name: Manage Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again file: group_saml_enforced_sso_new_account_spec.rb	211	0	0%
name: Manage Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again file: group_saml_enforced_sso_new_account_spec.rb	211	0	0%
name: Manage Group SAML SSO - Non enforced SSO lets group admin test settings file: group_saml_non_enforced_sso_spec.rb	211	0	0%
name: Manage Group SAML SSO - Non enforced SSO user logs in to group with SAML SSO file: group_saml_non_enforced_sso_spec.rb	211	0	0%
name: Manage Group SAML SSO - Non enforced SSO when SAML SSO is configured with a default membership role adds the new member with access level as set in SAML SSO configuration file: group_saml_non_enforced_sso_spec.rb	211	0	0%
name: Manage Invite group to group project behaves like invites group to project verifies group is added and members can access project with correct access level file: invite_group_to_project_spec.rb	56	0	0%
name: Manage Invite group to personal namespace project behaves like invites group to project verifies group is added and members can access project with correct access level file: invite_group_to_project_spec.rb	56	0	0%

unknown (1)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	926	0	0%

enablement (10)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Search using Elasticsearch tests reindexing after push file: elasticsearch_reindexing_spec.rb	240	0	0%
name: Create Search using Elasticsearch tests reindexing after webIDE file: elasticsearch_reindexing_spec.rb	239	0	0%
name: Enablement:Search Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description file: advanced_global_advanced_syntax_search_spec.rb	239	0	0%
name: Enablement:Search Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name file: advanced_global_advanced_syntax_search_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user file: elasticsearch_api_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user file: elasticsearch_api_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a public blob finds blob that matches file content file: blob_index_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a public issue finds issue that matches description file: issue_index_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a public merge request finds merge request that matches description file: merge_request_index_spec.rb	239	0	0%
name: Enablement:Search When using elasticsearch API to search for a public note finds note that matches note body file: note_index_spec.rb	239	0	0%

fulfillment (10)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Fulfillment Purchase CI minutes with an active subscription adds additional minutes to group namespace file: purchase_ci_spec.rb	14	0	0%
name: Fulfillment Purchase CI minutes with existing CI minutes packs adds additional minutes to group namespace file: purchase_ci_spec.rb	14	0	0%
name: Fulfillment Purchase CI minutes without active subscription adds additional minutes to group namespace file: purchase_ci_spec.rb	14	0	0%
name: Fulfillment Purchase group plan upgrades from free to ultimate file: upgrade_group_spec.rb	14	0	0%
name: Fulfillment Purchase group plan with existing CI minutes pack upgrades from free to premium with correct CI minutes file: upgrade_group_spec.rb	14	0	0%
name: Fulfillment Purchase starts a free trial when on about page with multiple eligible namespaces registers for a new trial file: free_trial_spec.rb	14	0	0%
name: Fulfillment Purchase starts a free trial when on billing page with only one eligible namespace registers for a new trial file: free_trial_spec.rb	14	0	0%
name: Fulfillment purchase storage with an active subscription behaves like Purchase storage adds additional storage to group namespace file: purchase_storage_spec.rb	14	0	0%
name: Fulfillment purchase storage with existing CI minutes packs behaves like Purchase storage adds additional storage to group namespace file: purchase_storage_spec.rb	14	0	0%
name: Fulfillment purchase storage without active subscription behaves like Purchase storage adds additional storage to group namespace file: purchase_storage_spec.rb	14	0	0%

non_devops (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Service ping default enabled When using default enabled from gitlab.yml config has service ping toggle enabled file: service_ping_default_enabled_spec.rb	1048	0	0%
name: Non-devops Performance bar display when logged in as an admin user shows results for the original request and AJAX requests file: performance_bar_spec.rb	1038	0	0%
name: Service ping disabled when disabled from gitlab.yml config has service ping toggle is disabled file: service_ping_disabled_spec.rb	223	0	0%

package (29)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Package Helm Registry using project deploy token pushes and pulls a helm chart file: helm_registry_spec.rb	910	0	0%
name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle file: maven_gradle_repository_spec.rb	910	0	0%
name: Package Maven group level endpoint duplication setting when disabled using a project deploy token prevents users from publishing group level Maven packages duplicates file: maven_group_level_spec.rb	910	0	0%
name: Package Maven group level endpoint duplication setting when enabled using a personal access token allows users to publish group level Maven packages duplicates file: maven_group_level_spec.rb	910	0	0%
name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven file: maven_project_level_spec.rb	910	0	0%
name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	910	0	0%
name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	910	0	0%
name: Package Generic Repository uploads a generic package and downloads it file: generic_repository_spec.rb	909	0	0%
name: Package Helm Registry using ci job token pushes and pulls a helm chart file: helm_registry_spec.rb	909	0	0%
name: Package Helm Registry using personal access token pushes and pulls a helm chart file: helm_registry_spec.rb	909	0	0%
name: Package Maven group level endpoint duplication setting when enabled using a ci job token allows users to publish group level Maven packages duplicates file: maven_group_level_spec.rb	909	0	0%
name: Package Maven group level endpoint duplication setting when enabled using a project deploy token allows users to publish group level Maven packages duplicates file: maven_group_level_spec.rb	909	0	0%
name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package file: maven_group_level_spec.rb	909	0	0%
name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package file: maven_group_level_spec.rb	909	0	0%
name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven file: maven_project_level_spec.rb	909	0	0%
name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	909	0	0%
name: Package PyPI Repository when at the project level publishes and installs a pypi package file: pypi_repository_spec.rb	909	0	0%
name: Package Self-managed Container Registry when tls is enabled pushes image and deletes tag file: container_registry_omnibus_spec.rb	223	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb	219	0	0%
name: Package Dependency Proxy Group SSO pulls an image using the dependency proxy on a group enforced SSO file: dependency_proxy_sso_spec.rb	211	0	0%
name: Package Container Registry pushes, pulls image to the registry and deletes image blob, manifest and tag file: container_registry_spec.rb	19	0	0%

plan (18)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Plan Issue creation when using attachments in comments comments on an issue with an attachment file: create_issue_spec.rb	1786	0	0%
name: Plan Issue creation closes an issue file: create_issue_spec.rb	1149	0	0%
name: Plan Issue creation creates an issue file: create_issue_spec.rb	1149	0	0%
name: Plan Issue closes via pushing a commit file: closes_issue_via_pushing_a_commit_spec.rb	1119	0	0%
name: Plan Custom issue templates creates an issue via custom template file: custom_issue_template_spec.rb	1118	0	0%
name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels file: editing_scoped_labels_spec.rb	996	0	0%
name: Plan Default issue templates uses default template when creating an issue file: default_issue_template_spec.rb	990	0	0%
name: Plan Configure issue board by label shows only issues that match the configured label file: configure_issue_board_by_label_spec.rb	987	0	0%
name: Plan Epics milestone dates API updates epic dates when adding another issue file: epics_milestone_dates_spec.rb	985	0	0%
name: Plan Epics milestone dates API updates epic dates when deleting milestones file: epics_milestone_dates_spec.rb	985	0	0%
name: Plan Epics milestone dates API updates epic dates when removing issue file: epics_milestone_dates_spec.rb	985	0	0%
name: Plan Epics milestone dates API updates epic dates when updating milestones file: epics_milestone_dates_spec.rb	985	0	0%
name: Plan Email Notification is received by a user for project invitation file: trigger_email_notification_spec.rb	224	0	0%
name: Plan Jira issue import imports issues from Jira file: jira_issue_import_spec.rb	223	0	0%
name: Plan Jira issues integration searching issues returns results file: jira_issues_list_spec.rb	212	0	0%
name: Plan Jira issues integration shows open issues file: jira_issues_list_spec.rb	212	0	0%
name: Plan Jira issues integration views an issue file: jira_issues_list_spec.rb	212	0	0%
name: Plan Discussion comments transient bugs comments with mention on a discussion in an issue file: comment_on_discussion_spec.rb	56	0	0%

protect (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Protect Threat Monitoring Policy Alert List page without k8s cluster can load Threat Monitoring page and view the policy alert list file: policy_alerts_list_spec.rb	905	0	0%
name: Protect Policies List page without k8s cluster can load Policies page and view the policies list file: policies_list_spec.rb	904	0	0%
name: Protect Policies List page without k8s cluster can navigate to Policy Editor page file: policies_list_spec.rb	903	0	0%

release (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Release Deploy key creation user adds a deploy key file: add_deploy_key_spec.rb	1113	0	0%
name: Release Deploy token creation user adds a deploy token file: add_deploy_token_spec.rb	1112	0	0%

verify (9)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Verify Add or Remove CI variable via UI user adds a CI variable file: add_remove_ci_variable_spec.rb	1460	0	0%
name: Verify Add or Remove CI variable via UI user removes a CI variable file: add_remove_ci_variable_spec.rb	1460	0	0%
name: Verify Pipeline editor can switch branches and target branch field updates accordingly file: pipeline_editor_branch_switcher_spec.rb	1117	0	0%
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb	1116	0	0%
name: Verify When job is configured to only run on merge_request_events only runs the job configured to run on merge requests file: mr_event_rule_pipeline_spec.rb	1109	0	0%
name: Verify When user is blocked pipeline schedule is canceled file: cancel_pipeline_when_block_user_spec.rb	1051	0	0%
name: Verify Artifacts when locked can be browsed file: locked_artifacts_spec.rb	1046	0	0%
name: Verify Merge trains transient bugs confirms that a merge train consistently completes and updates the UI file: merge_trains_transient_bug_spec.rb	28	0	0%
name: Verify Pipeline for project mirrors Github user commits to GitHub triggers CI pipeline file: pipeline_for_project_mirror_github_spec.rb	14	0	0%

Reliable specs with failures (2022-03-14 - 2022-03-28)

Total amount: 19

STAGE	COUNT
package	6
plan	8
release	3
verify	2

package (6)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Package Registry npm instance level endpoint using project deploy token push and pull a npm package via CI file: npm_instance_level_spec.rb	1227	2	0.16%
name: Package Registry npm project level endpoint using project deploy token push and pull a npm package via CI file: npm_project_level_spec.rb	1227	2	0.16%
name: Package Registry npm instance level endpoint using ci job token push and pull a npm package via CI file: npm_instance_level_spec.rb	1226	1	0.08%
name: Package Registry npm instance level endpoint using personal access token push and pull a npm package via CI file: npm_instance_level_spec.rb	1226	1	0.08%
name: Package Registry npm project level endpoint using ci job token push and pull a npm package via CI file: npm_project_level_spec.rb	1226	1	0.08%
name: Package Registry npm project level endpoint using personal access token push and pull a npm package via CI file: npm_project_level_spec.rb	1226	1	0.08%

plan (8)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Plan Assign Iterations assigns a group iteration to an existing issue file: assign_group_iteration_spec.rb	1097	8	0.73%
name: Plan Epics roadmap presents epic on roadmap file: roadmap_spec.rb	1305	2	0.15%
name: Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header file: sum_of_issues_weights_spec.rb	1305	2	0.15%
name: Plan Issues list successfully exports issues list as CSV file: export_as_csv_spec.rb	1433	2	0.14%
name: Plan Configurable issue board renames the issue board file: configurable_issue_board_spec.rb	1304	1	0.08%
name: Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it file: project_issue_boards_spec.rb	1307	1	0.08%
name: Plan Issue comments comments on an issue and edits the comment file: comment_issue_spec.rb	1430	1	0.07%
name: Plan Project milestone creates a project milestone file: create_project_milestone_spec.rb	1428	1	0.07%

release (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Release Parent-child pipelines dependent relationship parent pipeline fails if child fails file: parent_child_pipelines_dependent_relationship_spec.rb	1434	1	0.07%
name: Release Parent-child pipelines independent relationship parent pipeline passes even if child fails file: parent_child_pipelines_independent_relationship_spec.rb	1431	1	0.07%
name: Release Parent-child pipelines independent relationship parent pipelines passes if child passes file: parent_child_pipelines_independent_relationship_spec.rb	1431	1	0.07%

verify (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Verify Pipelines for merged results and merge trains merges via a merge train file: pipelines_for_merged_results_and_merge_trains_spec.rb	1304	2	0.15%
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results file: pipelines_for_merged_results_and_merge_trains_spec.rb	1304	1	0.08%