Skip to content

Reliable e2e test report

Candidates for promotion to blocking (2024-05-06 - 2024-05-20)

Note: MRs will be auto-created for promoting the top 10 specs sorted by most number of successful runs

Total amount: 177

STAGE COUNT
analytics 1
data_stores 15
create 23
fulfillment 2
monitor 9
govern 30
manage 26
package 14
plan 27
release 1
secure 1
systems 6
verify 22

Analytics (1)

Executions table groupanalytics instrumentation (1)
NAME RUNS FAILURES FAILURE RATE
Name: Analytics Service ping disabled when disabled from gitlab.yml config has service ping toggle is disabled
File: service_ping_disabled_spec.rb
164 0 0%

Data_stores (15)

Executions table grouptenant scale (4)
NAME RUNS FAILURES FAILURE RATE
Name: Data Stores prevent forking outside group when disabled allows forking outside of group
File: prevent_forking_outside_group_spec.rb
376 0 0%
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group
File: prevent_forking_outside_group_spec.rb
376 0 0%
Name: Data Stores Group with members can be shared with another group with correct access level
File: share_group_with_group_spec.rb
375 0 0%
Name: Configure Mattermost support user creates a group with a mattermost team
File: create_group_with_mattermost_team_spec.rb
164 0 0%
Executions table groupglobal search (11)
NAME RUNS FAILURES FAILURE RATE
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user
File: elasticsearch_api_spec.rb
271 0 0%
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user
File: elasticsearch_api_spec.rb
216 0 0%
Name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message
File: commit_index_spec.rb
216 0 0%
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description
File: merge_request_index_spec.rb
216 0 0%
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description
File: issue_index_spec.rb
216 0 0%
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body
File: note_index_spec.rb
216 0 0%
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user
File: elasticsearch_api_spec.rb
216 0 0%
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content
File: blob_index_spec.rb
216 0 0%
Name: Data Stores When using advanced search API to search for a user finds the user that matches username
File: user_index_spec.rb
208 0 0%
Name: Data Stores Search using Elasticsearch tests reindexing after webIDE
File: elasticsearch_reindexing_spec.rb
208 0 0%
Name: Data Stores Search using Elasticsearch tests reindexing after push
File: elasticsearch_reindexing_spec.rb
208 0 0%

Create (23)

Executions table groupide (4)
NAME RUNS FAILURES FAILURE RATE
Name: Create Add first file in Web IDE when a file with the same name already exists throws an error
File: add_first_file_in_web_ide_spec.rb
623 0 0%
Name: Create Code Suggestions in Web IDE on Self-managed with no license behaves like unauthorized returns no suggestion
File: code_suggestions_in_web_ide_spec.rb
164 0 0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with no Duo Pro add-on behaves like unauthorized returns no suggestion
File: code_suggestions_in_web_ide_spec.rb
153 0 0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with a Duo Pro add-on when seat is not assigned behaves like unauthorized returns no suggestion
File: code_suggestions_in_web_ide_spec.rb
149 0 0%
Executions table groupsource code (12)
NAME RUNS FAILURES FAILURE RATE
Name: Create Push Rules using non signed commits restricts files by name and size
File: push_rules_spec.rb
786 0 0%
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged
File: merge_with_code_owner_in_subgroup_spec.rb
631 0 0%
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged
File: merge_with_code_owner_in_subgroup_spec.rb
631 0 0%
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged
File: merge_with_code_owner_in_root_group_spec.rb
631 0 0%
Name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged
File: merge_with_code_owner_in_subgroup_spec.rb
631 0 0%
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged
File: merge_with_code_owner_in_root_group_spec.rb
631 0 0%
Name: Create Create a new project from a template commits via the api
File: commit_to_templated_project_spec.rb
631 0 0%
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository
File: license_detection_spec.rb
631 0 0%
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled
File: code_owners_with_protected_branch_and_squashed_commits_spec.rb
631 0 0%
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges
File: restrict_push_protected_branch_spec.rb
630 0 0%
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like user without push access fails to push
File: restrict_push_protected_branch_spec.rb
630 0 0%
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error
File: tag_revision_trigger_prereceive_hook_spec.rb
622 0 0%
Executions table groupcode creation (3)
NAME RUNS FAILURES FAILURE RATE
Name: Create Code Suggestions when code completion is requested on Self-managed with no license behaves like unauthorized returns no suggestion
File: code_suggestions_spec.rb
164 0 0%
Name: Create Code Suggestions when code completion is requested on Self-managed with a valid license with no Duo Pro add-on behaves like unauthorized returns no suggestion
File: code_suggestions_spec.rb
153 0 0%
Name: Create Code Suggestions when code completion is requested on Self-managed with a valid license with a Duo Pro add-on when seat is not assigned behaves like unauthorized returns no suggestion
File: code_suggestions_spec.rb
149 0 0%
Executions table groupcode review (4)
NAME RUNS FAILURES FAILURE RATE
Name: Create Merge Requests with a malformed URL returns 400
File: view_merge_requests_spec.rb
163 0 0%
Name: Create Merge request when merging once behaves like set to auto-merge merges after pipeline succeeds
File: merge_request_set_to_auto_merge_spec.rb
162 0 0%
Name: Create Merge request when merging several times behaves like set to auto-merge merges after pipeline succeeds
File: merge_request_set_to_auto_merge_spec.rb
144 0 0%
Name: Create Merge request push options merges when pipeline succeeds
File: push_options_mwps_spec.rb
76 0 0%

Fulfillment (2)

Executions table groupprovision (1)
NAME RUNS FAILURES FAILURE RATE
Name: Fulfillment Active license details shows up in subscription page
File: license_spec.rb
376 0 0%
Executions table groupsubscription management (1)
NAME RUNS FAILURES FAILURE RATE
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license
File: user_registration_billing_spec.rb
376 0 0%

Monitor (9)

Executions table groupobservability (2)
NAME RUNS FAILURES FAILURE RATE
Name: GitLab Metrics Sidekiq metrics via dedicated server returns 200 OK and serves metrics
File: metrics_spec.rb
164 0 0%
Name: GitLab Metrics Web metrics via dedicated server returns 200 OK and serves metrics
File: metrics_spec.rb
164 0 0%
Executions table grouprespond (7)
NAME RUNS FAILURES FAILURE RATE
Name: Monitor Alert when user is a maintainer when using HTTP endpoint integration behaves like notification on new alert sends email to user
File: email_notification_for_alert_spec.rb
164 0 0%
Name: Monitor Alert when user is a maintainer when using Prometheus integration behaves like notification on new alert sends email to user
File: email_notification_for_alert_spec.rb
164 0 0%
Name: Monitor Alert when user is an owner when using HTTP endpoint integration behaves like notification on new alert sends email to user
File: email_notification_for_alert_spec.rb
164 0 0%
Name: Monitor Alert when user is an owner when using Prometheus integration behaves like notification on new alert sends email to user
File: email_notification_for_alert_spec.rb
164 0 0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert
File: recovery_alert_resolves_correct_alert_spec.rb
164 0 0%
Name: Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident
File: recovery_alert_closes_correct_incident_spec.rb
157 0 0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident
File: recovery_alert_closes_correct_incident_spec.rb
156 0 0%

Govern (30)

Executions table groupauthentication (22)
NAME RUNS FAILURES FAILURE RATE
Name: Govern Project access token for the same project can be used to commit via the API
File: project_access_token_spec.rb
384 0 0%
Name: Govern User with minimal access to group is not allowed to push code via the CLI
File: minimal_access_user_spec.rb
383 0 0%
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI
File: user_access_termination_spec.rb
375 0 0%
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API
File: user_access_termination_spec.rb
375 0 0%
Name: Govern User when parent group membership is terminated is not allowed to commit via the API
File: user_access_termination_spec.rb
375 0 0%
Name: Govern LDAP Group sync with group cn method behaves like Group sync can create project access tokens
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern LDAP Group sync with group cn method behaves like Group sync can create group access tokens
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern LDAP login user logs into GitLab using LDAP credentials
File: log_into_gitlab_via_ldap_spec.rb
328 0 0%
Name: Govern LDAP Group sync with user filter method behaves like Group sync can create project access tokens
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern LDAP Group sync with group cn method behaves like Group sync has LDAP users synced
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern LDAP Group sync with user filter method behaves like Group sync can create group access tokens
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern LDAP Group sync with user filter method behaves like Group sync has LDAP users synced
File: group_ldap_sync_spec.rb
328 0 0%
Name: Govern Instance wide SAML SSO user logs in to gitlab with SAML SSO
File: login_via_instance_wide_saml_sso_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Non enforced SSO when SAML SSO is configured with a default membership role adds the new member with access level as set in SAML SSO configuration
File: group_saml_non_enforced_sso_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Non enforced SSO lets group admin test settings
File: group_saml_non_enforced_sso_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again
File: group_saml_enforced_sso_new_account_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Enforced SSO user clones and pushes to project within a group using Git HTTP
File: group_saml_enforced_sso_git_access_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again
File: group_saml_enforced_sso_new_account_spec.rb
164 0 0%
Name: Govern Group SAML SSO - Non enforced SSO user logs in to group with SAML SSO
File: group_saml_non_enforced_sso_spec.rb
164 0 0%
Name: Govern Mattermost login user logs into Mattermost using GitLab OAuth
File: log_into_mattermost_via_gitlab_spec.rb
164 0 0%
Name: Govern OAuth connects and logs in with GitHub OAuth
File: oauth_login_with_github_spec.rb
164 0 0%
Name: Govern while LDAP is enabled behaves like registration and login allows the user to register and login
File: register_spec.rb
164 0 0%
Executions table groupcompliance (1)
NAME RUNS FAILURES FAILURE RATE
Name: Govern Merge request approval with SAML SSO can be approved when requiring a password
File: saml_sso_merge_request_approve_spec.rb
164 0 0%
Executions table groupthreat insights (7)
NAME RUNS FAILURES FAILURE RATE
Name: Govern Security Reports displays false positives for the vulnerabilities
File: security_reports_spec.rb
384 0 0%
Name: Govern Security Reports displays security reports in the pipeline
File: security_reports_spec.rb
384 0 0%
Name: Govern Security Reports for dependency scanning displays the Dependency List
File: security_reports_spec.rb
384 0 0%
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab
File: vulnerability_management_spec.rb
384 0 0%
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget
File: vulnerability_management_spec.rb
384 0 0%
Name: Govern Vulnerability report in a project can export vulnerability report to csv
File: export_vulnerability_report_spec.rb
376 0 0%
Name: Govern vulnerability report with jira integration can successfully create a JIRA issue from vulnerability details page
File: vulnerabilities_jira_integration_spec.rb
164 0 0%

Manage (26)

Executions table groupimport and integrate (26)
NAME RUNS FAILURES FAILURE RATE
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab
File: jenkins_build_status_spec.rb
376 0 0%
Name: Manage Gitlab migration with import within same instance successfully imports project
File: gitlab_migration_project_spec.rb
375 0 0%
Name: Manage GitHub import when imported via api imports project
File: import_github_repo_spec.rb
164 0 0%
Name: Manage Gitlab migration with EE features imports group epics and iterations
File: gitlab_migration_group_spec.rb
164 0 0%
Name: Manage GitHub import when imported via UI imports a project
File: import_github_repo_spec.rb
164 0 0%
Name: Manage Gitlab migration with ci pipeline successfully imports ci pipeline
File: gitlab_migration_pipeline_spec.rb
164 0 0%
Name: Manage Gitlab migration with designs successfully imports design
File: gitlab_migration_issue_spec.rb
164 0 0%
Name: Manage Gitlab migration with group member member retains indirect membership in imported project
File: gitlab_migration_members_spec.rb
164 0 0%
Name: Manage GitHub import when imported via api imports repo push rules
File: import_github_repo_spec.rb
164 0 0%
Name: Manage Gitlab migration with associated merge request preserves related merge request
File: gitlab_migration_issue_spec.rb
164 0 0%
Name: Manage Gitlab migration with uninitialized project successfully imports project
File: gitlab_migration_project_spec.rb
164 0 0%
Name: Manage Gitlab migration with project member member retains direct membership in imported project
File: gitlab_migration_members_spec.rb
164 0 0%
Name: Manage Group WebHooks integration sends subgroup events
File: group_webhook_events_spec.rb
164 0 0%
Name: Manage Gitlab migration with wiki successfully imports project wiki
File: gitlab_migration_project_spec.rb
164 0 0%
Name: Manage Jira integration closes an issue via a merge request
File: jira_basic_integration_spec.rb
164 0 0%
Name: Manage Jira integration closes an issue via pushing a commit
File: jira_basic_integration_spec.rb
164 0 0%
Name: Manage Jira issues integration searching issues returns results
File: jira_issues_list_spec.rb
164 0 0%
Name: Manage Jira issues integration shows open issues
File: jira_issues_list_spec.rb
164 0 0%
Name: Manage Jira issues integration views an issue
File: jira_issues_list_spec.rb
164 0 0%
Name: Manage Pipeline status emails when pipeline fails sends an email
File: pipeline_status_emails_spec.rb
164 0 0%
Name: Manage Pipeline status emails when pipeline passes sends an email
File: pipeline_status_emails_spec.rb
164 0 0%
Name: Manage WebHooks integration sends a merge request event
File: webhook_events_spec.rb
164 0 0%
Name: Manage WebHooks integration sends a push event
File: webhook_events_spec.rb
164 0 0%
Name: Manage WebHooks integration sends a tag event
File: webhook_events_spec.rb
164 0 0%
Name: Manage WebHooks integration sends a wiki page event
File: webhook_events_spec.rb
164 0 0%
Name: Manage WebHooks integration sends an issues and note event
File: webhook_events_spec.rb
164 0 0%

Package (14)

Executions table groupcontainer registry (9)
NAME RUNS FAILURES FAILURE RATE
Name: Package Self-managed Container Registry when tls is disabled using docker:20.10.23 and a ci job token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:20.10.23 and a personal access token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:20.10.23 and a project deploy token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:23.0.6 and a ci job token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:23.0.6 and a personal access token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:23.0.6 and a project deploy token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:24.0.1 and a ci job token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:24.0.1 and a personal access token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Name: Package Self-managed Container Registry when tls is disabled using docker:24.0.1 and a project deploy token pushes image and deletes tag
File: container_registry_spec.rb
328 0 0%
Executions table grouppackage registry (5)
NAME RUNS FAILURES FAILURE RATE
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates
File: maven_group_level_spec.rb
876 0 0%
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates
File: maven_group_level_spec.rb
876 0 0%
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package
File: maven_group_level_spec.rb
876 0 0%
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package
File: maven_group_level_spec.rb
876 0 0%
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package
File: maven_group_level_spec.rb
876 0 0%

Plan (27)

Executions table groupproject management (8)
NAME RUNS FAILURES FAILURE RATE
Name: Plan Assign Iterations assigns a group iteration to an existing issue
File: assign_group_iteration_spec.rb
384 0 0%
Name: Plan Custom email customizes email with additional text
File: custom_email_spec.rb
384 0 0%
Name: Plan Issue closes via pushing a commit
File: closes_issue_via_pushing_a_commit_spec.rb
384 0 0%
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels
File: editing_scoped_labels_spec.rb
383 0 0%
Name: Plan Assignees update without refresh
File: real_time_assignee_spec.rb
383 0 0%
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence
File: create_group_iteration_spec.rb
383 0 0%
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence
File: create_group_iteration_spec.rb
383 0 0%
Name: Plan Email Notification is received by a user for project invitation
File: trigger_email_notification_spec.rb
164 0 0%
Executions table groupknowledge (15)
NAME RUNS FAILURES FAILURE RATE
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page
File: create_group_wiki_page_spec.rb
384 0 0%
Name: Plan Creating pages in group wikis when wiki is empty creates a new page
File: create_group_wiki_page_spec.rb
384 0 0%
Name: Plan Project Wiki with Wiki Page List has all expected links that work
File: project_based_list_spec.rb
384 0 0%
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work
File: project_based_list_spec.rb
384 0 0%
Name: Plan Testing group wiki can delete a group wiki page
File: delete_group_wiki_page_spec.rb
384 0 0%
Name: Plan Testing project wiki can delete a page
File: project_based_page_deletion_spec.rb
384 0 0%
Name: Plan Testing project wiki can delete a page with spaces in the path
File: project_based_page_deletion_spec.rb
384 0 0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki
File: project_based_content_creation_spec.rb
384 0 0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push
File: project_based_content_creation_spec.rb
384 0 0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki
File: project_based_content_creation_spec.rb
384 0 0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push
File: project_based_content_creation_spec.rb
384 0 0%
Name: Plan Testing wiki content creation inside a project by adding a wiki page with spaces in the path using git push
File: project_based_content_creation_spec.rb
384 0 0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page
File: project_based_content_manipulation_spec.rb
384 0 0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push
File: project_based_content_manipulation_spec.rb
384 0 0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page with spaces
File: project_based_content_manipulation_spec.rb
384 0 0%
Executions table groupproduct planning (4)
NAME RUNS FAILURES FAILURE RATE
Name: Plan Design Management user adds a design and modifies it
File: modify_design_content_spec.rb
384 0 0%
Name: Plan Design Management user archives a design
File: archive_design_content_spec.rb
384 0 0%
Name: Plan Epics milestone dates API updates epic dates when updating milestones
File: epics_milestone_dates_spec.rb
383 0 0%
Name: Plan Epics roadmap presents epic on roadmap
File: roadmap_spec.rb
163 0 0%

Release (1)

Executions table groupenvironments (1)
NAME RUNS FAILURES FAILURE RATE
Name: Release Operations Dashboard has many pipelines with appropriate statuses
File: pipeline_status_on_operation_dashboard_spec.rb
162 0 0%

Secure (1)

Executions table groupstatic analysis (1)
NAME RUNS FAILURES FAILURE RATE
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration
File: enable_scanning_from_configuration_spec.rb
397 0 0%

Systems (6)

Executions table groupgitaly (6)
NAME RUNS FAILURES FAILURE RATE
Name: Systems Gitaly Cluster replication queue allows replication of different repository after interruption
File: praefect_replication_queue_spec.rb
163 0 0%
Name: Systems Gitaly backend node recovery recovers from dataloss
File: backend_node_recovery_spec.rb
163 0 0%
Name: Systems Gitaly distributed reads reads from each node
File: distributed_reads_spec.rb
163 0 0%
Name: Systems Gitaly distributed reads when a node is unhealthy does not read from the unhealthy node
File: distributed_reads_spec.rb
163 0 0%
Name: Systems with Gitaly automatic failover and recovery automatically fails over
File: automatic_failover_and_recovery_spec.rb
163 0 0%
Name: Systems with Gitaly automatic failover and recovery when recovering from dataloss after failover automatically reconciles
File: automatic_failover_and_recovery_spec.rb
163 0 0%

Verify (22)

Executions table grouppipeline authoring (6)
NAME RUNS FAILURES FAILURE RATE
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request
File: update_ci_file_with_pipeline_editor_spec.rb
384 0 0%
Name: Verify CI component runs in project pipeline with correct inputs
File: run_component_in_project_pipeline_spec.rb
376 0 0%
Name: Verify CI catalog when sorting with created at behaves like descending order by default displays from last to first
File: ci_catalog_sorting_spec.rb
375 0 0%
Name: Verify CI catalog when sorting with released at behaves like descending order by default displays from last to first
File: ci_catalog_sorting_spec.rb
375 0 0%
Name: Verify CI catalog when sorting with created at behaves like ascending order displays from first to last
File: ci_catalog_sorting_spec.rb
375 0 0%
Name: Verify CI catalog when sorting with released at behaves like ascending order displays from first to last
File: ci_catalog_sorting_spec.rb
375 0 0%
Executions table grouprunner (3)
NAME RUNS FAILURES FAILURE RATE
Name: Verify Group runner registration user registers a new group runner
File: register_group_runner_spec.rb
384 0 0%
Name: Verify Runner fleet management shows group runner online count
File: group_runner_status_counts_spec.rb
384 0 0%
Name: Verify Runner registration user registers a new project runner
File: register_runner_spec.rb
384 0 0%
Executions table grouppipeline security (11)
NAME RUNS FAILURES FAILURE RATE
Name: Verify Job artifacts when exposed show up in MR widget
File: expose_job_artifacts_in_mr_spec.rb
384 0 0%
Name: Verify Project artifacts when user tries bulk deletion successfully delete them
File: user_can_bulk_delete_artifacts_spec.rb
384 0 0%
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true
File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb
384 0 0%
Name: Verify UI defined variable is not inheritable by default
File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb
384 0 0%
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false
File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb
384 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
164 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
161 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
161 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
161 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
124 0 0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
118 0 0%
Executions table grouppipeline execution (2)
NAME RUNS FAILURES FAILURE RATE
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job
File: trigger_child_pipeline_with_manual_spec.rb
384 0 0%
Name: Verify when pipeline is blocked can still merge MR successfully
File: merge_mr_when_pipline_is_blocked_spec.rb
163 0 0%

Blocking specs with failures (2024-05-06 - 2024-05-20)

Note:

  • Only failures from the nightly, e2e-package-and-test and e2e-test-on-gdk pipelines are considered

  • Only specs that have a failure rate of equal or greater than 1 percent are considered

  • Quarantine MRs will be created for all specs listed below

Total amount: 5

STAGE COUNT
analytics 1
create 2
package 1
plan 1

Analytics (1)

Executions table groupproduct analytics (1)
NAME RUNS FAILURES FAILURE RATE
Name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests
File: performance_bar_spec.rb
Exceptions:
- <code data-sourcepos="442:322-442:409">expected 'QA::Page::Layout::PerformanceBar.has_performance_bar?' to be truthy, got false</code>
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA4CQJH0N9ZK1J3QJ8HY2SK
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA7EYC50SHRKNP9DMJFYBFP
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXABD9A4VVBA49AGP1R2A894
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAJ90GZB7ZY6DSSWV2EQDZ6
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAS65YVMG4PHCWAQQY3EXPY
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAZXDASB7YE0C4CFVST01ZY
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXB6W0BPJ7E0G0TVNCV0HM8P
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBDNSNBF7ZCMWHKK0G9DRJH
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBMK4C6AJQ048YM0P1701X2
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBVD59JM2WA5VYR2YGD5MN8
539 21 3.9%

Create (2)

Executions table groupcode review (2)
NAME RUNS FAILURES FAILURE RATE
Name: Create new merge request from the event notification after a push via the git CLI creates a merge request
File: create_merge_request_from_push_notification_spec.rb
Exceptions:
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA4ER9Q0G1H2AJTWHW8HXNJ
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA7D14G0VQAFEN1VNS5ZBS0
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAB9JJS12HJ4FNA9SBEZJZS
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAJ6RPDTGCXF50MSN6CQ8PC
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAS0X3Y11JBNJMH70WJ61KG
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAZYZHM4GT3BDJDJ2WEFEAV
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXB6XZ64XNGJ2ACN8VC0KZ88
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBDMYV5N9BQ48ECPG07K4WZ
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBMG5ZV1MHHXXA9WAXCRJQP
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBVBEDWB3Q95QMAW9C5SAA5
- Wait for 'Create merge request' push notification failed after 60 seconds
794 13 1.64%
Name: Create Merge request rebasing user rebases source branch of merge request
File: rebase_merge_request_spec.rb
Exceptions:
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA4D9WDJ8F1FJYKSVG88FC5
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA7E5ZTVY5TNNCWNR8Y99P2
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXABB0CCYAB7K6RS3BDM5398
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAJ6VF1SXD0YAT4VRKZT1Y5
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAS1PPSQEA484TA9AFD9Y86
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAZWZ0JD8486W6PX0TJWVTA
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXB6YDAC7C97R1DPQFVQTNQZ
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBDM0AM68P50SRJG61XYM60
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBMH1VH2BNZDXQ0SEP8RC0X
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXBVC99Y7H0KXCQ1FX0YEEHB
- Merge did not appear to be successful
- <code data-sourcepos="454:3014-454:3064">Unable to find css "[data-testid=\"merge-button\"]"</code>
795 12 1.51%

Package (1)

Executions table grouppackage registry (1)
NAME RUNS FAILURES FAILURE RATE
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI
File: npm_instance_level_spec.rb
Exceptions:
- RSpec::Core::MultipleExceptionError
1040 11 1.06%

Plan (1)

Executions table groupoptimize (1)
NAME RUNS FAILURES FAILURE RATE
Name: Plan Merge Request Analytics shows merge request analytics chart and stats
File: mr_analytics_spec.rb
Exceptions:
- <code data-sourcepos="476:275-476:302">Wait failed after 60 seconds</code>
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXA7DR7G5CYK7F0X86RA5956
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXABCDR04P9QNEEV8FKQQY0G
- Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["Failed to create repository","Failed to create repository"]}}'.Correlation Id: 01HXAS538J0E5W6M5H0P1BRKPP
548 11 2.01%