Reliable e2e test report
- Candidates for promotion to reliable (2022-05-30 - 2022-06-13)
- Reliable specs with failures (2022-05-30 - 2022-06-13)
Candidates for promotion to reliable (2022-05-30 - 2022-06-13)
Total amount: 224
STAGE | COUNT |
---|---|
manage | 51 |
create | 94 |
unknown | 5 |
enablement | 9 |
fulfillment | 4 |
package | 19 |
plan | 9 |
release | 3 |
secure | 6 |
verify | 24 |
manage (51)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage User can be followed and their activity seen file: follow_user_activity_spec.rb |
1382 | 0 | 0% |
name: Manage standard when admin approval is required allows user login after approval file: register_spec.rb |
1378 | 0 | 0% |
name: Manage Gitlab migration with repository successfully imports repository file: gitlab_migration_project_spec.rb |
1373 | 0 | 0% |
name: Manage Gitlab migration with uninitialized project successfully imports project file: gitlab_migration_project_spec.rb |
1373 | 0 | 0% |
name: Manage Gitlab migration with wiki successfully imports project wiki file: gitlab_migration_project_spec.rb |
1373 | 0 | 0% |
name: Manage 2FA allows using 2FA recovery code once only file: 2fa_recovery_spec.rb |
1371 | 0 | 0% |
name: Manage Gitlab migration with project issues successfully imports issue file: gitlab_migration_issue_spec.rb |
1370 | 0 | 0% |
name: Manage standard when admin approval is not required behaves like registration and login allows the user to registers and login file: register_spec.rb |
1370 | 0 | 0% |
name: Manage standard when admin approval is not required when user account is deleted allows recreating with same credentials file: register_spec.rb |
1370 | 0 | 0% |
name: Manage 2FA allows enforcing 2FA via UI and logging in with 2FA file: log_in_with_2fa_spec.rb |
1369 | 0 | 0% |
name: Manage Gitlab migration with group member member retains indirect membership in imported project file: gitlab_migration_members_spec.rb |
1369 | 0 | 0% |
name: Manage 2FA allows 2FA code recovery via ssh file: 2fa_ssh_recovery_spec.rb |
1368 | 0 | 0% |
name: Manage Gitlab migration with project member member retains direct membership in imported project file: gitlab_migration_members_spec.rb |
1368 | 0 | 0% |
name: Manage rate limits throttles authenticated api requests by user file: rate_limits_spec.rb |
1366 | 0 | 0% |
name: Manage Gitlab migration with release successfully imports project release file: gitlab_migration_release_spec.rb |
1365 | 0 | 0% |
name: Manage prevent forking outside group when disabled allows forking outside of group file: prevent_forking_outside_group_spec.rb |
1272 | 0 | 0% |
name: Manage Group Change project creation level behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
1271 | 0 | 0% |
name: Manage Group Disable and Enable LFS behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
1271 | 0 | 0% |
name: Manage Group Enable and disable allow user request access behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
1271 | 0 | 0% |
name: Manage Group Enable and disable membership lock behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
1271 | 0 | 0% |
name: Manage Group with members can be shared with another group with correct access level file: share_group_with_group_spec.rb |
1271 | 0 | 0% |
name: Manage Group Add and remove project access behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
1269 | 0 | 0% |
name: Manage Group Add group behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
1269 | 0 | 0% |
name: Manage Group Add user, change access level, remove user behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
1269 | 0 | 0% |
name: Manage Group Update group name behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
1269 | 0 | 0% |
name: Manage Project Add deploy key behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
1247 | 0 | 0% |
name: Manage Project Add project behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
1247 | 0 | 0% |
name: Manage Project Add user access as guest behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
1247 | 0 | 0% |
name: Manage Project Change visibility behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
1247 | 0 | 0% |
name: Manage Project templates built-in successfully imports the project using template file: project_templates_spec.rb |
1195 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to commit via the API file: minimal_access_user_spec.rb |
1195 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to push code via the CLI file: minimal_access_user_spec.rb |
1195 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to edit files via the UI file: minimal_access_user_spec.rb |
1194 | 0 | 0% |
name: Manage Gitlab migration imports group epics and iterations file: gitlab_migration_group_spec.rb |
1192 | 0 | 0% |
name: Manage Group Change repository size limit behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
1192 | 0 | 0% |
name: Manage Instance Add SSH key behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb |
1179 | 0 | 0% |
name: Manage Instance Change password behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb |
1179 | 0 | 0% |
name: Manage Instance Failed sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb |
1179 | 0 | 0% |
name: Manage Instance Start and stop user impersonation behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb |
1179 | 0 | 0% |
name: Manage Instance Successful sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb |
1179 | 0 | 0% |
name: Manage Group Enable and disable 2FA requirement behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
1178 | 0 | 0% |
name: Manage Project Export file download behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
1174 | 0 | 0% |
name: Manage LDAP login user logs into GitLab using LDAP credentials file: log_into_gitlab_via_ldap_spec.rb |
456 | 0 | 0% |
name: Manage LDAP Group sync user filter method has LDAP users synced file: group_ldap_sync_spec.rb |
414 | 0 | 0% |
name: Manage LDAP Group sync using group cn method has LDAP users synced file: group_ldap_sync_spec.rb |
414 | 0 | 0% |
name: Configure Mattermost support user creates a group with a mattermost team file: create_group_with_mattermost_team_spec.rb |
228 | 0 | 0% |
name: Manage Instance wide SAML SSO user logs in to gitlab with SAML SSO file: login_via_instance_wide_saml_sso_spec.rb |
228 | 0 | 0% |
name: Manage Mattermost login user logs into Mattermost using GitLab OAuth file: log_into_mattermost_via_gitlab_spec.rb |
228 | 0 | 0% |
name: Manage while LDAP is enabled behaves like registration and login allows the user to registers and login file: register_spec.rb |
228 | 0 | 0% |
name: Manage LDAP admin sync sets and removes user's admin status file: admin_ldap_sync_spec.rb |
207 | 0 | 0% |
name: Manage Group SAML SSO - Enforced SSO user clones and pushes to project within a group using Git HTTP file: group_saml_enforced_sso_git_access_spec.rb |
206 | 0 | 0% |
create (94)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create Download merge request patch and diff views the merge request email patches file: view_merge_request_diff_patch_spec.rb |
1686 | 0 | 0% |
name: Create Download merge request patch and diff views the merge request plain diff file: view_merge_request_diff_patch_spec.rb |
1686 | 0 | 0% |
name: Create Create a new project from a template commits via the api file: commit_to_templated_project_spec.rb |
1465 | 0 | 0% |
name: Create File templates user adds .gitignore via file template Android file: add_file_template_spec.rb |
1465 | 0 | 0% |
name: Create File templates user adds .gitlab-ci.yml via file template Julia file: add_file_template_spec.rb |
1465 | 0 | 0% |
name: Create File templates user adds Dockerfile via file template Python file: add_file_template_spec.rb |
1465 | 0 | 0% |
name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 file: add_file_template_spec.rb |
1465 | 0 | 0% |
name: Create Merge request push options sets merge when pipeline succeeds file: push_options_mwps_spec.rb |
1465 | 0 | 0% |
name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error file: add_new_directory_in_web_ide_spec.rb |
1464 | 0 | 0% |
name: Create Add a directory in Web IDE when user adds a new empty directory shows in the tree view but cannot be committed file: add_new_directory_in_web_ide_spec.rb |
1464 | 0 | 0% |
name: Create Merge request push options sets title and description file: push_options_title_description_spec.rb |
1464 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
1464 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
1464 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
1464 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
1464 | 0 | 0% |
name: Create Wiki Page deletion has removed the deleted page correctly file: project_based_page_deletion_spec.rb |
1464 | 0 | 0% |
name: Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different file: project_archive_compare_spec.rb |
1463 | 0 | 0% |
name: Create Design Management user archives a design file: archive_design_content_spec.rb |
1463 | 0 | 0% |
name: Create Project snippet creation user creates a project snippet file: create_project_snippet_spec.rb |
1463 | 0 | 0% |
name: Create Upload a file in Web IDE when a file with the same name already exists throws an error file: upload_new_file_in_web_ide_spec.rb |
1463 | 0 | 0% |
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI file: clone_push_pull_project_snippet_spec.rb |
1463 | 0 | 0% |
name: Create Wiki has changed the directory file: project_based_directory_management_spec.rb |
1463 | 0 | 0% |
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly file: file_with_unusual_name_spec.rb |
1462 | 0 | 0% |
name: Create Git clone over HTTP user performs a deep clone file: clone_spec.rb |
1462 | 0 | 0% |
name: Create Git clone over HTTP user performs a shallow clone file: clone_spec.rb |
1462 | 0 | 0% |
name: Create Merge request push options sets labels file: push_options_labels_spec.rb |
1462 | 0 | 0% |
name: Create Merge request push options when labels are set already removes them on subsequent push file: push_options_labels_spec.rb |
1462 | 0 | 0% |
name: Create Merge request squashing user squashes commits while merging file: squash_merge_request_spec.rb |
1462 | 0 | 0% |
name: Create Wiki Page List has all expected links that work file: project_based_list_spec.rb |
1462 | 0 | 0% |
name: Create Wiki Sidebar has all expected links that work file: project_based_list_spec.rb |
1462 | 0 | 0% |
name: Create Design Management user adds a design and modifies it file: modify_design_content_spec.rb |
1461 | 0 | 0% |
name: Create Merge request push options sets a target branch file: push_options_target_branch_spec.rb |
1461 | 0 | 0% |
name: Create Open Web IDE from Diff Tab opens and edits a multi-file merge request in Web IDE from Diff Tab file: open_web_ide_from_diff_tab_spec.rb |
1461 | 0 | 0% |
name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository file: push_mirroring_over_http_spec.rb |
1461 | 0 | 0% |
name: Create Cherry picking a commit creates a merge request file: cherry_pick_commit_spec.rb |
1460 | 0 | 0% |
name: Create Merge request rebasing user rebases source branch of merge request file: rebase_merge_request_spec.rb |
1460 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
1460 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
1460 | 0 | 0% |
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI file: clone_push_pull_personal_snippet_spec.rb |
1460 | 0 | 0% |
name: Create Wiki testing wiki content manipulation inside a project by manipulating content on the page file: project_based_content_manipulation_spec.rb |
1460 | 0 | 0% |
name: Create Wiki testing wiki content manipulation inside a project by manipulating content on the page using git push file: project_based_content_manipulation_spec.rb |
1460 | 0 | 0% |
name: Create Design Management user adds a design and annotates it file: add_design_content_spec.rb |
1459 | 0 | 0% |
name: Create File management user deletes a file via the Web file: delete_file_via_web_spec.rb |
1459 | 0 | 0% |
name: Create First file using Web IDE creates the first file in an empty project via Web IDE file: create_first_file_in_web_ide_spec.rb |
1459 | 0 | 0% |
name: Create Review a merge request in Web IDE opens and edits a merge request in Web IDE file: review_merge_request_spec.rb |
1459 | 0 | 0% |
name: Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI file: create_merge_request_from_push_notification_spec.rb |
1458 | 0 | 0% |
name: Create Wiki testing wiki content creation inside a project by adding a home page to the wiki file: project_based_content_creation_spec.rb |
1458 | 0 | 0% |
name: Create Wiki testing wiki content creation inside a project by adding a home page to the wiki using git push file: project_based_content_creation_spec.rb |
1458 | 0 | 0% |
name: Create Wiki testing wiki content creation inside a project by adding a second page to the wiki file: project_based_content_creation_spec.rb |
1458 | 0 | 0% |
name: Create Wiki testing wiki content creation inside a project by adding a second page to the wiki using git push file: project_based_content_creation_spec.rb |
1458 | 0 | 0% |
name: Create Merge request push options removes the source branch file: push_options_remove_source_branch_spec.rb |
1457 | 0 | 0% |
name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name file: default_branch_name_setting_spec.rb |
1368 | 0 | 0% |
name: Create Default branch name instance setting sets the default branch name for a new project file: default_branch_name_setting_spec.rb |
1368 | 0 | 0% |
name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit file: push_over_http_file_size_spec.rb |
1366 | 0 | 0% |
name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit file: push_over_http_file_size_spec.rb |
1366 | 0 | 0% |
name: Create Push Rules using signed commits restricts to signed commits file: push_rules_spec.rb |
1274 | 0 | 0% |
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users file: push_rules_spec.rb |
1273 | 0 | 0% |
name: Create Push Rules with commits restricted to verified emails rejects unverified emails file: push_rules_spec.rb |
1273 | 0 | 0% |
name: Create Contribution Analytics tests contributions file: contribution_analytics_spec.rb |
1270 | 0 | 0% |
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled file: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
1270 | 0 | 0% |
name: Create Codeowners merge request assigns code owners as approvers file: assign_code_owners_spec.rb |
1269 | 0 | 0% |
name: Create Wiki Creating pages in Group Wikis when Wiki has a home page adds a second page file: create_group_wiki_page_spec.rb |
1269 | 0 | 0% |
name: Create Wiki Creating pages in Group Wikis when Wiki is empty creates a home page file: create_group_wiki_page_spec.rb |
1269 | 0 | 0% |
name: Create File Locking checks file locked by other user to be disabled file: file_locking_spec.rb |
1248 | 0 | 0% |
name: Create File Locking creates a merge request and fails to merge file: file_locking_spec.rb |
1248 | 0 | 0% |
name: Create File Locking locks a directory and tries to push as a second user file: file_locking_spec.rb |
1248 | 0 | 0% |
name: Create File Locking locks a file and tries to push as a second user file: file_locking_spec.rb |
1248 | 0 | 0% |
name: Create File Locking locks a file and unlocks in list file: file_locking_spec.rb |
1248 | 0 | 0% |
name: Create Codeowners displays owners specified in CODEOWNERS file file: code_owners_spec.rb |
1198 | 0 | 0% |
name: Create File Locking when refactor_blob_viewer is enabled checks file locked by other user to be disabled file: file_locking_spec.rb |
1192 | 0 | 0% |
name: Create File Locking when refactor_blob_viewer is enabled creates a merge request and fails to merge file: file_locking_spec.rb |
1192 | 0 | 0% |
name: Create File Locking when refactor_blob_viewer is enabled locks a file and tries to push as a second user file: file_locking_spec.rb |
1192 | 0 | 0% |
name: Create Changing Gitaly repository storage when moving from Gitaly to Gitaly Cluster behaves like repository storage move confirms a finished status after moving project repository storagefile: changing_repository_storage_spec.rb |
243 | 0 | 0% |
name: Create Changing Gitaly repository storage when moving from one Gitaly storage to another behaves like repository storage move confirms a finished status after moving project repository storagefile: changing_repository_storage_spec.rb |
228 | 0 | 0% |
name: Create Gitaly Using mTLS pushes to gitaly file: gitaly_mtls_spec.rb |
228 | 0 | 0% |
name: Create Gitaly repository storage creates a 2nd fork after moving the parent project file: move_project_create_fork_spec.rb |
228 | 0 | 0% |
name: Create Snippet repository storage moves snippet repository from one Gitaly storage to another file: snippet_repository_storage_move_spec.rb |
228 | 0 | 0% |
name: Create Gitaly Backend node recovery recovers from dataloss file: backend_node_recovery_spec.rb |
227 | 0 | 0% |
name: Create Gitaly Distributed reads reads from each node file: distributed_reads_spec.rb |
227 | 0 | 0% |
name: Create Gitaly Distributed reads when a node is unhealthy does not read from the unhealthy node file: distributed_reads_spec.rb |
227 | 0 | 0% |
name: Create Gitaly automatic failover and recovery automatically fails over file: automatic_failover_and_recovery_spec.rb |
227 | 0 | 0% |
name: Create Gitaly automatic failover and recovery when recovering from dataloss after failover automatically reconciles file: automatic_failover_and_recovery_spec.rb |
227 | 0 | 0% |
name: Create Praefect connectivity commands in a healthy environment confirms healthy connection to database file: praefect_connectivity_spec.rb |
227 | 0 | 0% |
name: Create Praefect connectivity commands in a healthy environment confirms healthy connection to gitaly nodes file: praefect_connectivity_spec.rb |
227 | 0 | 0% |
name: Create Praefect connectivity commands in an unhealthy environment diagnoses connection issues to gitaly nodes file: praefect_connectivity_spec.rb |
227 | 0 | 0% |
name: Create Praefect connectivity commands in an unhealthy environment diagnoses unhealthy connection to database file: praefect_connectivity_spec.rb |
227 | 0 | 0% |
name: Create Praefect dataloss commands allows admin resolve scenario where data cannot be recovered file: praefect_dataloss_spec.rb |
227 | 0 | 0% |
name: Create Praefect dataloss commands confirms that changes are synced across all storages file: praefect_dataloss_spec.rb |
227 | 0 | 0% |
name: Create Praefect dataloss commands identifies how many changes are not in sync across storages file: praefect_dataloss_spec.rb |
227 | 0 | 0% |
name: Create Praefect repository commands allows admin to control the number of replicas of data file: praefect_repo_sync_spec.rb |
227 | 0 | 0% |
name: Create Praefect repository commands allows admin to manage difference between praefect database and disk state file: praefect_repo_sync_spec.rb |
227 | 0 | 0% |
name: Create Jira integration closes an issue via a merge request file: jira_basic_integration_spec.rb |
226 | 0 | 0% |
name: Create Jira integration closes an issue via pushing a commit file: jira_basic_integration_spec.rb |
226 | 0 | 0% |
name: Create Group Wiki repository storage moves group Wiki repository from one Gitaly storage to another file: group_wiki_repository_storage_move_spec.rb |
207 | 0 | 0% |
unknown (5)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
1192 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
1192 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
1192 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
1190 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
1190 | 0 | 0% |
enablement (9)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Enablement:Search When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user file: elasticsearch_api_spec.rb |
250 | 0 | 0% |
name: Enablement:Search Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description file: advanced_global_advanced_syntax_search_spec.rb |
228 | 0 | 0% |
name: Enablement:Search Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name file: advanced_global_advanced_syntax_search_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user file: elasticsearch_api_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user file: elasticsearch_api_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a public blob finds blob that matches file content file: blob_index_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a public issue finds issue that matches description file: issue_index_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a public merge request finds merge request that matches description file: merge_request_index_spec.rb |
228 | 0 | 0% |
name: Enablement:Search When using elasticsearch API to search for a public note finds note that matches note body file: note_index_spec.rb |
228 | 0 | 0% |
fulfillment (4)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Fulfillment Active license details shows up in subscription page file: license_spec.rb |
1179 | 0 | 0% |
name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license file: user_registration_billing_spec.rb |
1178 | 0 | 0% |
name: Fulfillment Cloud activation code activates instance with correct subscription details file: cloud_activation_spec.rb |
212 | 0 | 0% |
name: Fulfillment Purchase starts a free trial when on about page with multiple eligible namespaces registers for a new trial file: free_trial_spec.rb |
16 | 0 | 0% |
package (19)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Package Composer Repository publishes a composer package and deletes it file: composer_registry_spec.rb |
920 | 0 | 0% |
name: Package Helm Registry using ci job token pushes and pulls a helm chart file: helm_registry_spec.rb |
920 | 0 | 0% |
name: Package Helm Registry using personal access token pushes and pulls a helm chart file: helm_registry_spec.rb |
920 | 0 | 0% |
name: Package Helm Registry using project deploy token pushes and pulls a helm chart file: helm_registry_spec.rb |
920 | 0 | 0% |
name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle file: maven_gradle_repository_spec.rb |
920 | 0 | 0% |
name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle file: maven_gradle_repository_spec.rb |
920 | 0 | 0% |
name: Package Generic Repository uploads a generic package and downloads it file: generic_repository_spec.rb |
918 | 0 | 0% |
name: Package PyPI Repository when at the project level publishes and installs a pypi package file: pypi_repository_spec.rb |
917 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a ci job token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a personal access token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Self-managed Container Registry when tls is disabled using docker:20.10 and a project deploy token pushes image and deletes tag file: container_registry_omnibus_spec.rb |
456 | 0 | 0% |
name: Package Conan Repository publishes, installs, and deletes a Conan package file: conan_repository_spec.rb |
299 | 0 | 0% |
name: Package Self-managed Container Registry when tls is enabled pushes image and deletes tag file: container_registry_omnibus_spec.rb |
228 | 0 | 0% |
plan (9)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan filter issue comments activities filters comments and activities in an issue file: filter_issue_comments_spec.rb |
1460 | 0 | 0% |
name: Plan Custom issue templates creates an issue via custom template file: custom_issue_template_spec.rb |
1458 | 0 | 0% |
name: Plan Configure issue board by label shows only issues that match the configured label file: configure_issue_board_by_label_spec.rb |
1273 | 0 | 0% |
name: Plan Default issue templates uses default template when creating an issue file: default_issue_template_spec.rb |
1269 | 0 | 0% |
name: Plan Epics milestone dates API updates epic dates when adding another issue file: epics_milestone_dates_spec.rb |
1266 | 0 | 0% |
name: Plan Epics milestone dates API updates epic dates when deleting milestones file: epics_milestone_dates_spec.rb |
1266 | 0 | 0% |
name: Plan Epics milestone dates API updates epic dates when removing issue file: epics_milestone_dates_spec.rb |
1266 | 0 | 0% |
name: Plan Email Notification is received by a user for project invitation file: trigger_email_notification_spec.rb |
227 | 0 | 0% |
name: Plan Jira issue import imports issues from Jira file: jira_issue_import_spec.rb |
226 | 0 | 0% |
release (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Release Deploy key creation user adds a deploy key file: add_deploy_key_spec.rb |
1466 | 0 | 0% |
name: Release Deploy token creation user adds a deploy token file: add_deploy_token_spec.rb |
1464 | 0 | 0% |
name: Release Pages runs a Pages-specific pipeline file: pages_pipeline_spec.rb |
1463 | 0 | 0% |
secure (6)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Secure Security Reports in a Merge Request can create an issue from a vulnerability file: vulnerability_management_spec.rb |
1270 | 0 | 0% |
name: Secure Security Reports in a Merge Request can dismiss a vulnerability with a reason file: vulnerability_management_spec.rb |
1270 | 0 | 0% |
name: Secure License merge request widget manage licenses from the merge request file: merge_request_license_widget_spec.rb |
1268 | 0 | 0% |
name: Secure Security Reports in a Merge Request displays the Security reports in the merge request file: create_merge_request_with_secure_spec.rb |
1267 | 0 | 0% |
name: Secure project vulnerability report can successfully bulk change status in vulnerability report file: change_vulnerability_status_spec.rb |
1262 | 0 | 0% |
name: Secure project vulnerability report can successfully change status of a vulnerability in vulnerability details page file: change_vulnerability_status_spec.rb |
1262 | 0 | 0% |
verify (24)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Pipeline editor can switch branches and target branch field updates accordingly file: pipeline_editor_branch_switcher_spec.rb |
1465 | 0 | 0% |
name: Verify Include multiple files from a project runs the pipeline with composed config file: include_multiple_files_from_a_project_spec.rb |
1464 | 0 | 0% |
name: Verify Pipeline with protected variable does not expose variable on unprotected branch file: pipeline_with_protected_variable_spec.rb |
1464 | 0 | 0% |
name: Verify Pipeline with protected variable exposes variable on protected branch file: pipeline_with_protected_variable_spec.rb |
1464 | 0 | 0% |
name: Verify UI defined variable is inheritable when forward:pipeline_variables is true file: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
1464 | 0 | 0% |
name: Verify Runner registration user registers a new specific runner file: register_runner_spec.rb |
1463 | 0 | 0% |
name: Verify When job is configured to only run on merge_request_events only runs the job configured to run on merge requests file: mr_event_rule_pipeline_spec.rb |
1463 | 0 | 0% |
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb |
1462 | 0 | 0% |
name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job file: trigger_child_pipeline_with_manual_spec.rb |
1462 | 0 | 0% |
name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables file: trigger_matrix_spec.rb |
1462 | 0 | 0% |
name: Verify UI defined variable is not inheritable by default file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
1461 | 0 | 0% |
name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
1461 | 0 | 0% |
name: Verify Update CI file with pipeline editor creates new pipeline and target branch file: update_ci_file_with_pipeline_editor_spec.rb |
1460 | 0 | 0% |
name: Verify When pipeline is blocked can still merge MR successfully file: merge_mr_when_pipline_is_blocked_spec.rb |
1460 | 0 | 0% |
name: Verify Code coverage statistics creates an MR with code coverage statistics file: view_code_coverage_spec.rb |
1459 | 0 | 0% |
name: Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value file: custom_variable_spec.rb |
1457 | 0 | 0% |
name: Verify When user is blocked pipeline schedule is canceled file: cancel_pipeline_when_block_user_spec.rb |
1383 | 0 | 0% |
name: Verify Artifacts when locked can be browsed file: locked_artifacts_spec.rb |
1382 | 0 | 0% |
name: Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project file: pipeline_subscription_with_group_owned_project_spec.rb |
1271 | 0 | 0% |
name: Verify In merge trains new thread discussion does not drop MR file: new_discussion_not_dropping_merge_trains_mr_spec.rb |
1269 | 0 | 0% |
name: Verify Operations Dashboard has many pipelines with appropriate statuses file: pipeline_status_on_operation_dashboard_spec.rb |
1268 | 0 | 0% |
name: Verify Multi-project pipelines creates a multi-project pipeline with artifact download file: multi-project_pipelines_spec.rb |
1264 | 0 | 0% |
name: Verify Cancelling merge request in merge train when user cancels the merge request does not create a TODO task file: user_cancel_merge_request_in_merge_train_spec.rb |
1192 | 0 | 0% |
name: Verify Pipeline for project mirrors Github user commits to GitHub triggers CI pipeline file: pipeline_for_project_mirror_github_spec.rb |
16 | 0 | 0% |
Reliable specs with failures (2022-05-30 - 2022-06-13)
Total amount: 64
STAGE | COUNT |
---|---|
configure | 1 |
create | 6 |
manage | 19 |
package | 18 |
plan | 13 |
verify | 7 |
configure (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Configure Kubernetes Agent deploys a K8s manifest file file: kubernetes_agent_spec.rb |
182 | 2 | 1.1% |
create (6)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them file: copy_snippet_file_contents_spec.rb |
1664 | 24 | 1.44% |
name: Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them file: copy_snippet_file_contents_spec.rb |
1662 | 20 | 1.2% |
name: Create Add batch suggestions to a Merge Request applies multiple suggestions file: batch_suggestion_spec.rb |
1757 | 2 | 0.11% |
name: Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes to the protected branch file: push_protected_branch_spec.rb |
1758 | 1 | 0.06% |
name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch file: push_protected_branch_spec.rb |
1758 | 1 | 0.06% |
name: Create Reverting a commit creates a merge request file: revert_commit_spec.rb |
1763 | 1 | 0.06% |
manage (19)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage Project transfer between groups user transfers a project between groups file: transfer_project_spec.rb |
1023 | 20 | 1.96% |
name: Manage Project access tokens can be created and revoked via the UI file: project_access_token_spec.rb |
1667 | 14 | 0.84% |
name: Manage Project access token for a different project cannot be used to commit via the API file: project_access_token_spec.rb |
1759 | 3 | 0.17% |
name: Manage Project access token for a different project cannot be used to create a file via the project API file: project_access_token_spec.rb |
1759 | 3 | 0.17% |
name: Manage User after parent group membership termination is not allowed to commit via the API file: user_access_termination_spec.rb |
1463 | 2 | 0.14% |
name: Manage User after parent group membership termination is not allowed to create a file via the API file: user_access_termination_spec.rb |
1463 | 2 | 0.14% |
name: Manage User after parent group membership termination is not allowed to push code via the CLI file: user_access_termination_spec.rb |
1463 | 2 | 0.14% |
name: Manage Group access when restricted by user's ip address with UI allows access file: restrict_by_ip_address_spec.rb |
1174 | 1 | 0.09% |
name: Manage Create project badge creates project badge successfully file: create_project_badge_spec.rb |
1759 | 1 | 0.06% |
name: Manage Personal project permissions when user is added as Maintainer has Maintainer role without Owner permissions file: personal_project_permissions_spec.rb |
1761 | 1 | 0.06% |
name: Manage Project activity user creates an event in the activity page upon Git push file: view_project_activity_spec.rb |
1764 | 1 | 0.06% |
name: Manage Repository tags when not protected behaves like successful tag creation can be created by developer_user file: protected_tags_spec.rb |
1762 | 1 | 0.06% |
name: Manage Repository tags when not protected behaves like successful tag creation can be created by maintainer_user file: protected_tags_spec.rb |
1762 | 1 | 0.06% |
name: Manage Repository tags when protected behaves like successful tag creation can be created by maintainer_user file: protected_tags_spec.rb |
1762 | 1 | 0.06% |
name: Manage Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user file: protected_tags_spec.rb |
1762 | 1 | 0.06% |
name: Manage Users API GET /users file: users_spec.rb |
1762 | 1 | 0.06% |
name: Manage Users API GET /users/:username with a valid username file: users_spec.rb |
1762 | 1 | 0.06% |
name: Manage Users API GET /users/:username with an invalid username file: users_spec.rb |
1762 | 1 | 0.06% |
name: Manage project insights page behaves like default insights page displays issues and merge requests dashboards file: default_insights_spec.rb |
1570 | 1 | 0.06% |
package (18)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Package Container Registry pushes project image to the container registry and deletes tag file: container_registry_spec.rb |
168 | 5 | 2.98% |
name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
1220 | 9 | 0.74% |
name: Package Package Registry npm instance level endpoint using personal access token push and pull a npm package via CI file: npm_instance_level_spec.rb |
1219 | 7 | 0.57% |
name: Package Package Registry npm project level endpoint using project deploy token push and pull a npm package via CI file: npm_project_level_spec.rb |
1220 | 7 | 0.57% |
name: Package Package Registry npm project level endpoint using personal access token push and pull a npm package via CI file: npm_project_level_spec.rb |
1219 | 6 | 0.49% |
name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
1219 | 5 | 0.41% |
name: Package Package Registry npm instance level endpoint using project deploy token push and pull a npm package via CI file: npm_instance_level_spec.rb |
1218 | 5 | 0.41% |
name: Package Package Registry npm project level endpoint using ci job token push and pull a npm package via CI file: npm_project_level_spec.rb |
1220 | 5 | 0.41% |
name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
1219 | 4 | 0.33% |
name: Package Package Registry npm instance level endpoint using ci job token push and pull a npm package via CI file: npm_instance_level_spec.rb |
1218 | 4 | 0.33% |
name: Package Maven group level endpoint duplication setting when disabled using a personal access token prevents users from publishing group level Maven packages duplicates file: maven_group_level_spec.rb |
1215 | 2 | 0.16% |
name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package file: maven_group_level_spec.rb |
1215 | 2 | 0.16% |
name: Package Maven group level endpoint duplication setting when disabled using a ci job token prevents users from publishing group level Maven packages duplicates file: maven_group_level_spec.rb |
1215 | 1 | 0.08% |
name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package file: maven_group_level_spec.rb |
1214 | 1 | 0.08% |
name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package file: maven_group_level_spec.rb |
1214 | 1 | 0.08% |
name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
1212 | 1 | 0.08% |
name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
1212 | 1 | 0.08% |
name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
1212 | 1 | 0.08% |
plan (13)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan Assign Iterations assigns a group iteration to an existing issue file: assign_group_iteration_spec.rb |
1359 | 2 | 0.15% |
name: Plan Epics Management Resources created via API Visit epic first closes and reopens an epic file: epics_management_spec.rb |
1566 | 2 | 0.13% |
name: Plan Epics Management Resources created via API Visit epic first comments on epic file: epics_management_spec.rb |
1568 | 2 | 0.13% |
name: Plan check xss occurence in @mentions in issues mentions a user in a comment file: check_mentions_for_xss_spec.rb |
1468 | 1 | 0.07% |
name: Plan Configurable issue board renames the issue board file: configurable_issue_board_spec.rb |
1569 | 1 | 0.06% |
name: Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic file: epics_management_spec.rb |
1566 | 1 | 0.06% |
name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions file: epics_management_spec.rb |
1566 | 1 | 0.06% |
name: Plan Epics Management creates a confidential epic file: epics_management_spec.rb |
1566 | 1 | 0.06% |
name: Plan Epics Management creates an epic file: epics_management_spec.rb |
1566 | 1 | 0.06% |
name: Plan Epics roadmap presents epic on roadmap file: roadmap_spec.rb |
1570 | 1 | 0.06% |
name: Plan Issues list successfully exports issues list as CSV file: export_as_csv_spec.rb |
1762 | 1 | 0.06% |
name: Plan Milestones Group milestone behaves like milestone assigned to existing issue is assigned to an existing issue file: assign_milestone_spec.rb |
1759 | 1 | 0.06% |
name: Plan collapse comments in issue discussions collapses and expands reply for comments in an issue file: collapse_comments_in_discussions_spec.rb |
1759 | 1 | 0.06% |
verify (7)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Include local config file paths with wildcard runs the pipeline with composed config file: include_local_config_file_paths_with_wildcard_spec.rb |
1762 | 1 | 0.06% |
name: Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails file: parent_child_pipelines_dependent_relationship_spec.rb |
1571 | 1 | 0.06% |
name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes file: parent_child_pipelines_dependent_relationship_spec.rb |
1571 | 1 | 0.06% |
name: Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails file: parent_child_pipelines_independent_relationship_spec.rb |
1761 | 1 | 0.06% |
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results file: pipelines_for_merged_results_and_merge_trains_spec.rb |
1570 | 1 | 0.06% |
name: Verify Pipelines for merged results and merge trains merges via a merge train file: pipelines_for_merged_results_and_merge_trains_spec.rb |
1570 | 1 | 0.06% |
name: Verify Run pipeline with web only rule can trigger pipeline file: run_pipeline_via_web_only_spec.rb |
1765 | 1 | 0.06% |