Reliable e2e test report

Candidates for promotion to blocking (2024-10-07 - 2024-10-21)
Blocking specs with failures (2024-10-07 - 2024-10-21)

Candidates for promotion to blocking (2024-10-07 - 2024-10-21)

Note: MRs will be auto-created for promoting the top 10 specs sorted by most number of successful runs

Total amount: 33

STAGE	COUNT
create	5
govern	6
manage	2
monitor	3
plan	6
secure	1
systems	1
verify	9

Create (5)

Executions table (4)

NAME	RUNS	FAILURE RATE
Name: Create Merge Requests with a malformed URL returns 400 or 302 File: view_merge_requests_spec.rb	924	0%
Name: Create Merge request when merging once behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	169	0%
Name: Create Merge request when merging several times behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	168	0%
Name: Create Merge request push options merges when pipeline succeeds File: push_options_mwps_spec.rb	89	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Create Push rules using non signed commits restricts files by name and size File: push_rules_spec.rb	1067	0	0%

Govern (6)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	171	0	0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	171	0	0%

Executions table (4)

NAME	RUNS	FAILURE RATE
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb	398	0%
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb	398	0%
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb	398	0%
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb	398	0%

Manage (2)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Manage GitHub import when imported via api imports project File: import_github_repo_spec.rb Exceptions: - `Fabrication of QA::Resource::ProjectImportedFromGithub using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01JADNEXG0349H3CY2Q7ZMXRTR`	171	0	0%
Name: Manage GitHub import when imported via UI imports a project File: import_github_repo_spec.rb	169	0	0%

Monitor (3)

Executions table (3)

NAME	RUNS	FAILURE RATE
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb	169	0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	161	0%
Name: Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	159	0%

Plan (6)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions File: epics_management_spec.rb	400	0	0%

Executions table (5)

NAME	RUNS	FAILURE RATE
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb	406	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page with spaces File: project_based_content_manipulation_spec.rb	406	0%
Name: Plan Testing project wiki can delete a page with spaces in the path File: project_based_page_deletion_spec.rb	402	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb	401	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb	401	0%

Secure (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure Continuous Vulnerability Scanning when new vulnerabilities are ingested updates the vulnerability list with new vulnerabilities within the past 14 days File: cvs_dependency_scanning_spec.rb	171	0	0%

Systems (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Systems Gitaly using mTLS pushes to gitaly File: gitaly_mtls_spec.rb	171	0	0%

Verify (9)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb	406	0	0%
Name: Verify CI catalog when sorting with released at behaves like descending order by default displays from last to first File: ci_catalog_sorting_spec.rb	169	0	0%

Executions table (7)

NAME	RUNS	FAILURE RATE
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	169	0%
Name: Verify when pipeline is blocked can still merge MR successfully File: merge_mr_when_pipline_is_blocked_spec.rb	169	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	168	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	167	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	166	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	127	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	125	0%

Blocking specs with failures (2024-10-07 - 2024-10-21)

Note:

Only failures from the nightly, e2e-test-on-omnibus and e2e-test-on-gdk pipelines are considered
Only specs that have a failure rate of equal or greater than 1 percent are considered
Quarantine MRs will be created for all specs listed below

Total amount: 3

STAGE	COUNT
ai_powered	1
manage	1
secure	1

Ai_powered (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Ai-powered Duo Chat when initiating Duo Chat on Self-managed behaves like Duo Chat gets a response back from Duo Chat File: duo_chat_spec.rb Exceptions: - `RSpec::Core::MultipleExceptionError`	153	17	11.11%

Manage (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Manage Gitlab migration with EE features imports group epics and iterations File: gitlab_migration_group_spec.rb Exceptions: - `uninitialized constant QA::AwardEmoji`	171	10	5.85%

Secure (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure On Demand DAST when a scan is ran populates On Demand scan history and vulnerability report File: on_demand_dast_spec.rb Exceptions: - `expected QA::Page::Project::Pipeline::Show to have job "dast"` - `uninitialized constant QA::Service::DockerRun::Webgoat::WEBGOAT_SSRF_PORT`	395	33	8.35%