Reliable e2e test report

Candidates for promotion to blocking (2024-06-10 - 2024-06-24)

Candidates for promotion to blocking (2024-06-10 - 2024-06-24)

Note: MRs will be auto-created for promoting the top 10 specs sorted by most number of successful runs

Total amount: 154

STAGE	COUNT
analytics	1
data_stores	14
create	14
fulfillment	3
monitor	9
govern	24
manage	26
package	5
plan	25
release	1
secure	2
systems	6
verify	24

Analytics (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Analytics Service ping disabled when disabled from gitlab.yml config has service ping toggle is disabled File: service_ping_disabled_spec.rb	169	0	0%

Data_stores (14)

Executions table (4)

NAME	RUNS	FAILURE RATE
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb	200	0%
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb	200	0%
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb	200	0%
Name: Configure Mattermost support user creates a group with a mattermost team File: create_group_with_mattermost_team_spec.rb	170	0%

Executions table (10)

NAME	RUNS	FAILURE RATE
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb	214	0%
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb	214	0%
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb	214	0%
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb	214	0%
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb	214	0%
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb	214	0%
Name: Data Stores Search using Elasticsearch tests reindexing after push File: elasticsearch_reindexing_spec.rb	202	0%
Name: Data Stores Search using Elasticsearch tests reindexing after webIDE File: elasticsearch_reindexing_spec.rb	202	0%
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb	202	0%
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb	43	0%

Create (14)

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Create Closing Web IDE shows an alert when there are unsaved changes File: closing_web_ide_with_unsaved_changes_spec.rb	548	0%
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb	547	0%
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb	547	0%
Name: Create Add first file in Web IDE when a file with the same name already exists throws an error File: add_first_file_in_web_ide_spec.rb	536	0%
Name: Create Code Suggestions in Web IDE on Self-managed with no license behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	170	0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with no Duo Pro add-on behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	169	0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with a Duo Pro add-on when seat is assigned behaves like a code completion suggestion returns a code completion suggestion which can be accepted File: code_suggestions_in_web_ide_spec.rb	167	0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with a Duo Pro add-on when seat is not assigned behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	162	0%

Executions table (4)

NAME	RUNS	FAILURE RATE
Name: Create Merge Requests with a malformed URL returns 400 File: view_merge_requests_spec.rb	168	0%
Name: Create Merge request when merging once behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	167	0%
Name: Create Merge request when merging several times behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	149	0%
Name: Create Merge request push options merges when pipeline succeeds File: push_options_mwps_spec.rb	88	0%

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb	705	0	0%
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb	538	0	0%

Fulfillment (3)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Fulfillment Cloud activation code activates instance with correct subscription details File: cloud_activation_spec.rb	168	0	0%
Name: Fulfillment Remove cloud subscription successfully removes a cloud activation and shows flash notice File: cloud_activation_spec.rb	168	0	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Fulfillment Utilization User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb	202	0	0%

Monitor (9)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: GitLab Metrics Sidekiq metrics via dedicated server returns 200 OK and serves metrics File: metrics_spec.rb	170	0	0%
Name: GitLab Metrics Web metrics via dedicated server returns 200 OK and serves metrics File: metrics_spec.rb	170	0	0%

Executions table (7)

NAME	RUNS	FAILURE RATE
Name: Monitor Alert when user is a maintainer when using HTTP endpoint integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb	170	0%
Name: Monitor Alert when user is a maintainer when using Prometheus integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb	170	0%
Name: Monitor Alert when user is an owner when using HTTP endpoint integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb	170	0%
Name: Monitor Alert when user is an owner when using Prometheus integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb	170	0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb	168	0%
Name: Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	162	0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	159	0%

Govern (24)

Executions table (16)

NAME	RUNS	FAILURE RATE
Name: Govern User with minimal access to group is not allowed to push code via the CLI File: minimal_access_user_spec.rb	213	0%
Name: Govern User when parent group membership is terminated is not allowed to commit via the API File: user_access_termination_spec.rb	202	0%
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API File: user_access_termination_spec.rb	202	0%
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI File: user_access_termination_spec.rb	202	0%
Name: Govern OAuth behaves like Instance OAuth Application creates oauth application and uses it to login File: login_via_oauth_and_oidc_with_gitlab_as_idp_spec.rb	200	0%
Name: Govern OIDC behaves like Instance OAuth Application creates oidc application and uses it to login File: login_via_oauth_and_oidc_with_gitlab_as_idp_spec.rb	200	0%
Name: Govern Group SAML SSO - Enforced SSO user clones and pushes to project within a group using Git HTTP File: group_saml_enforced_sso_git_access_spec.rb	170	0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	170	0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	170	0%
Name: Govern Group SAML SSO - Non enforced SSO lets group admin test settings File: group_saml_non_enforced_sso_spec.rb	170	0%
Name: Govern Group SAML SSO - Non enforced SSO user logs in to group with SAML SSO File: group_saml_non_enforced_sso_spec.rb	170	0%
Name: Govern Group SAML SSO - Non enforced SSO when SAML SSO is configured with a default membership role adds the new member with access level as set in SAML SSO configuration File: group_saml_non_enforced_sso_spec.rb	170	0%
Name: Govern Mattermost login user logs into Mattermost using GitLab OAuth File: log_into_mattermost_via_gitlab_spec.rb	170	0%
Name: Govern OAuth connects and logs in with GitHub OAuth File: oauth_login_with_github_spec.rb	170	0%
Name: Govern while LDAP is enabled behaves like registration and login allows the user to register and login File: register_spec.rb	170	0%
Name: Govern Instance wide SAML SSO user logs in to gitlab with SAML SSO File: login_via_instance_wide_saml_sso_spec.rb	169	0%

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb	212	0%
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb	211	0%
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb	211	0%
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb	211	0%
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb	211	0%
Name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON File: vulnerability_security_training_spec.rb	211	0%
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb	200	0%
Name: Govern vulnerability report with jira integration can successfully create a JIRA issue from vulnerability details page File: vulnerabilities_jira_integration_spec.rb	170	0%

Manage (26)

Executions table (26)

NAME	RUNS	FAILURE RATE
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb Exceptions: - `Fabrication of QA::Resource::BulkImportGroup using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01J0Y0DTA4MSN17K56A8PZBXS1`	200	0%
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb	200	0%
Name: Manage Jira integration closes an issue via pushing a commit File: jira_basic_integration_spec.rb	171	0%
Name: Manage WebHooks integration sends a push event File: webhook_events_spec.rb	171	0%
Name: Manage WebHooks integration sends a tag event File: webhook_events_spec.rb	171	0%
Name: Manage WebHooks integration sends a wiki page event File: webhook_events_spec.rb	171	0%
Name: Manage WebHooks integration sends an issues and note event File: webhook_events_spec.rb	171	0%
Name: Manage Jira integration closes an issue via a merge request File: jira_basic_integration_spec.rb	170	0%
Name: Manage Jira issues integration searching issues returns results File: jira_issues_list_spec.rb	170	0%
Name: Manage Jira issues integration shows open issues File: jira_issues_list_spec.rb	170	0%
Name: Manage Jira issues integration views an issue File: jira_issues_list_spec.rb	170	0%
Name: Manage Pipeline status emails when pipeline fails sends an email File: pipeline_status_emails_spec.rb	170	0%
Name: Manage Pipeline status emails when pipeline passes sends an email File: pipeline_status_emails_spec.rb	170	0%
Name: Manage GitHub import when imported via api imports project File: import_github_repo_spec.rb	169	0%
Name: Manage GitHub import when imported via api imports repo push rules File: import_github_repo_spec.rb	169	0%
Name: Manage Gitlab migration with EE features imports group epics and iterations File: gitlab_migration_group_spec.rb	169	0%
Name: Manage Gitlab migration with associated merge request preserves related merge request File: gitlab_migration_issue_spec.rb	169	0%
Name: Manage Gitlab migration with ci pipeline successfully imports ci pipeline File: gitlab_migration_pipeline_spec.rb	169	0%
Name: Manage Gitlab migration with designs successfully imports design File: gitlab_migration_issue_spec.rb	169	0%
Name: Manage Gitlab migration with group member member retains indirect membership in imported project File: gitlab_migration_members_spec.rb	169	0%
Name: Manage Gitlab migration with project member member retains direct membership in imported project File: gitlab_migration_members_spec.rb	169	0%
Name: Manage Gitlab migration with uninitialized project successfully imports project File: gitlab_migration_project_spec.rb	169	0%
Name: Manage Gitlab migration with wiki successfully imports project wiki File: gitlab_migration_project_spec.rb	169	0%
Name: Manage Group WebHooks integration sends subgroup events File: group_webhook_events_spec.rb	169	0%
Name: Manage WebHooks integration sends a merge request event File: webhook_events_spec.rb	169	0%
Name: Manage GitHub import when imported via UI imports a project File: import_github_repo_spec.rb	168	0%

Package (5)

Executions table (4)

NAME	RUNS	FAILURE RATE
Name: Package Dependency Proxy Group SSO pulls an image using the dependency proxy on a group enforced SSO File: dependency_proxy_sso_spec.rb	170	0%
Name: Package Dependency Proxy using docker:24.0.1 and a ci job token pulls an image using the dependency proxy File: dependency_proxy_spec.rb	170	0%
Name: Package Dependency Proxy using docker:24.0.1 and a group deploy token pulls an image using the dependency proxy File: dependency_proxy_spec.rb	170	0%
Name: Package Dependency Proxy using docker:24.0.1 and a personal access token pulls an image using the dependency proxy File: dependency_proxy_spec.rb	170	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb	238	0	0%

Plan (25)

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb	214	0%
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb	214	0%
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb	213	0%
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb	213	0%
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb	212	0%
Name: Plan Custom email customizes email with additional text File: custom_email_spec.rb	212	0%
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb	212	0%
Name: Plan Email Notification is received by a user for project invitation File: trigger_email_notification_spec.rb	170	0%

Executions table (15)

NAME	RUNS	FAILURE RATE
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb	214	0%
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb	214	0%
Name: Plan Testing project wiki can delete a page with spaces in the path File: project_based_page_deletion_spec.rb	214	0%
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb	213	0%
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb	213	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb	213	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb	213	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb	213	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb	213	0%
Name: Plan Testing wiki content creation inside a project by adding a wiki page with spaces in the path using git push File: project_based_content_creation_spec.rb	213	0%
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb	211	0%
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb	211	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb	211	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb	211	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page with spaces File: project_based_content_manipulation_spec.rb	211	0%

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb	212	0	0%
Name: Plan Epics roadmap presents epic on roadmap File: roadmap_spec.rb	168	0	0%

Release (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Release Operations Dashboard has many pipelines with appropriate statuses File: pipeline_status_on_operation_dashboard_spec.rb	168	0	0%

Secure (2)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration File: enable_scanning_from_configuration_spec.rb	212	0	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure On Demand DAST when a scan is ran populates On Demand scan history and vulnerability report File: on_demand_dast_spec.rb	202	0	0%

Systems (6)

Executions table (6)

NAME	RUNS	FAILURE RATE
Name: Systems Gitaly Cluster replication queue allows replication of different repository after interruption File: praefect_replication_queue_spec.rb	170	0%
Name: Systems Gitaly backend node recovery recovers from dataloss File: backend_node_recovery_spec.rb	170	0%
Name: Systems Gitaly distributed reads reads from each node File: distributed_reads_spec.rb	170	0%
Name: Systems Gitaly distributed reads when a node is unhealthy does not read from the unhealthy node File: distributed_reads_spec.rb	170	0%
Name: Systems with Gitaly automatic failover and recovery automatically fails over File: automatic_failover_and_recovery_spec.rb	170	0%
Name: Systems with Gitaly automatic failover and recovery when recovering from dataloss after failover automatically reconciles File: automatic_failover_and_recovery_spec.rb	170	0%

Verify (24)

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb	213	0%
Name: Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb	212	0%
Name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb	212	0%
Name: Verify CI component runs in project pipeline with correct inputs File: run_component_in_project_pipeline_spec.rb	200	0%
Name: Verify CI catalog when sorting with created at behaves like ascending order displays from first to last File: ci_catalog_sorting_spec.rb	199	0%
Name: Verify CI catalog when sorting with created at behaves like descending order by default displays from last to first File: ci_catalog_sorting_spec.rb	199	0%
Name: Verify CI catalog when sorting with released at behaves like ascending order displays from first to last File: ci_catalog_sorting_spec.rb	199	0%
Name: Verify CI catalog when sorting with released at behaves like descending order by default displays from last to first File: ci_catalog_sorting_spec.rb	199	0%

Executions table (13)

NAME	RUNS	FAILURE RATE
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb	211	0%
Name: Verify Pipeline configuration access keyword when access is set to all behaves like artifact access verifies artifact access for developer user with all access File: job_artifacts_access_keyword_spec.rb	196	0%
Name: Verify Pipeline configuration access keyword when access is set to all behaves like artifact access verifies artifact access for non-member user with all access File: job_artifacts_access_keyword_spec.rb	196	0%
Name: Verify Pipeline configuration access keyword when access is set to developer behaves like artifact access verifies artifact access for developer user with developer access File: job_artifacts_access_keyword_spec.rb	196	0%
Name: Verify Pipeline configuration access keyword when access is set to developer behaves like artifact access verifies artifact access for non-member user with developer access File: job_artifacts_access_keyword_spec.rb	196	0%
Name: Verify Pipeline configuration access keyword when access is set to none behaves like artifact access verifies artifact access for developer user with none access File: job_artifacts_access_keyword_spec.rb Exceptions: - `Resource at https://staging.gitlab.com/api/v4/projects/gitlab-qa-sandbox-group-2%2Fqa-test-2024-06-17-15-38-28-ee146e859e508efd%2Fproject-with-artifacts-8260fb59b2b040ec?private_token=[****] could not be found (502): '<!DOCTYPE html><html><head> ...`	196	0%
Name: Verify Pipeline configuration access keyword when access is set to none behaves like artifact access verifies artifact access for non-member user with none access File: job_artifacts_access_keyword_spec.rb	196	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	168	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	167	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	165	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	165	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	128	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	121	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb	213	0	0%

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb	211	0	0%
Name: Verify when pipeline is blocked can still merge MR successfully File: merge_mr_when_pipline_is_blocked_spec.rb	167	0	0%