Reliable e2e test report

Candidates for promotion to blocking (2024-09-09 - 2024-09-23)
Blocking specs with failures (2024-09-09 - 2024-09-23)

Candidates for promotion to blocking (2024-09-09 - 2024-09-23)

Note: MRs will be auto-created for promoting the top 10 specs sorted by most number of successful runs

Total amount: 60

STAGE	COUNT
ai_powered	1
analytics	1
data_stores	1
create	14
monitor	4
govern	16
manage	8
plan	6
verify	9

Ai_powered (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Ai-powered Duo Chat when initiating Duo Chat on Self-managed behaves like Duo Chat gets a response back from Duo Chat File: duo_chat_spec.rb	151	0	0%

Analytics (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Analytics Service ping disabled when disabled from gitlab.yml config has service ping toggle is disabled File: service_ping_disabled_spec.rb	154	0	0%

Data_stores (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Configure Mattermost support user creates a group with a mattermost team File: create_group_with_mattermost_team_spec.rb	154	0	0%

Create (14)

Executions table (3)

NAME	RUNS	FAILURE RATE
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with no Duo Pro add-on behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	153	0%
Name: Create Code Suggestions in Web IDE on Self-managed with no license behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	153	0%
Name: Create Code Suggestions in Web IDE on Self-managed with a valid license with a Duo Pro add-on when seat is not assigned behaves like unauthorized returns no suggestion File: code_suggestions_in_web_ide_spec.rb	150	0%

Executions table (7)

NAME	RUNS	FAILURE RATE
Name: Create Code Suggestions when code generation is requested on Self-managed with a valid license with no Duo Pro add-on behaves like unauthorized returns no suggestion File: code_suggestions_spec.rb	154	0%
Name: Create Code Suggestions when code generation is requested on Self-managed with no license behaves like unauthorized returns no suggestion File: code_suggestions_spec.rb	154	0%
Name: Create Code Suggestions when code completion on Self-managed with a valid license with a Duo Pro add-on when seat is assigned behaves like code suggestions API returns a suggestion File: code_suggestions_spec.rb	151	0%
Name: Create Code Suggestions when code completion on Self-managed with a valid license with a Duo Pro add-on when seat is assigned behaves like direct code completion returns a completion directly from AI gateway File: code_suggestions_spec.rb	151	0%
Name: Create Code Suggestions when code generation is requested on Self-managed with a valid license with a Duo Pro add-on when seat is assigned behaves like code suggestions API returns a suggestion File: code_suggestions_spec.rb	151	0%
Name: Create Code Suggestions when code generation is requested on Self-managed with a valid license with a Duo Pro add-on when seat is not assigned behaves like unauthorized returns no suggestion File: code_suggestions_spec.rb	151	0%
Name: Create Code Suggestions when code generation is requested when streaming on Self-managed with a valid license with a Duo Pro add-on when seat is assigned behaves like code suggestions API using streaming streams a suggestion File: code_suggestions_spec.rb	151	0%

Executions table (3)

NAME	RUNS	FAILURE RATE
Name: Create Merge request when merging once behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	153	0%
Name: Create Merge request when merging several times behaves like set to auto-merge merges after pipeline succeeds File: merge_request_set_to_auto_merge_spec.rb	153	0%
Name: Create Merge request push options merges when pipeline succeeds File: push_options_mwps_spec.rb	75	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Create Push rules using non signed commits restricts files by name and size File: push_rules_spec.rb	974	0	0%

Monitor (4)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: GitLab Metrics Sidekiq metrics via dedicated server returns 200 OK and serves metrics File: metrics_spec.rb	154	0	0%

Executions table (3)

NAME	RUNS	FAILURE RATE
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb	153	0%
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	149	0%
Name: Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only closes the correct incident File: recovery_alert_closes_correct_incident_spec.rb	144	0%

Govern (16)

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Govern Group SAML SSO - Enforced SSO user clones and pushes to project within a group using Git HTTP File: group_saml_enforced_sso_git_access_spec.rb	154	0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	154	0%
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb	154	0%
Name: Govern Group SAML SSO - Non enforced SSO lets group admin test settings File: group_saml_non_enforced_sso_spec.rb	154	0%
Name: Govern Group SAML SSO - Non enforced SSO user logs in to group with SAML SSO File: group_saml_non_enforced_sso_spec.rb	154	0%
Name: Govern Group SAML SSO - Non enforced SSO when SAML SSO is configured with a default membership role adds the new member with access level as set in SAML SSO configuration File: group_saml_non_enforced_sso_spec.rb	154	0%
Name: Govern Instance wide SAML SSO user logs in to gitlab with SAML SSO File: login_via_instance_wide_saml_sso_spec.rb	154	0%
Name: Govern Mattermost login user logs into Mattermost using GitLab OAuth File: log_into_mattermost_via_gitlab_spec.rb	154	0%

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Govern Merge request approval with SAML SSO can be approved when requiring a password File: saml_sso_merge_request_approve_spec.rb	154	0	0%

Executions table (7)

NAME	RUNS	FAILURE RATE
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb	371	0%
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb	371	0%
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb	371	0%
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb	371	0%
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb	371	0%
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb	370	0%
Name: Govern vulnerability report with jira integration can successfully create a JIRA issue from vulnerability details page File: vulnerabilities_jira_integration_spec.rb	154	0%

Manage (8)

Executions table (8)

NAME	RUNS	FAILURE RATE
Name: Manage WebHooks integration sends a push event File: webhook_events_spec.rb	155	0%
Name: Manage WebHooks integration sends a tag event File: webhook_events_spec.rb	155	0%
Name: Manage WebHooks integration sends a wiki page event File: webhook_events_spec.rb	155	0%
Name: Manage WebHooks integration sends an issues and note event File: webhook_events_spec.rb	155	0%
Name: Manage GitHub import when imported via UI imports a project File: import_github_repo_spec.rb	153	0%
Name: Manage GitHub import when imported via api imports project File: import_github_repo_spec.rb Exceptions: - `Fabrication of QA::Resource::ProjectImportedFromGithub using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01J7SXMKTGPVKBWPWVY0MS8AS6`	153	0%
Name: Manage GitHub import when imported via api imports repo push rules File: import_github_repo_spec.rb Exceptions: - `Fabrication of QA::Resource::ProjectImportedFromGithub using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01J7SXMQXFV2BRV7G0X8ZC77DJ`	153	0%
Name: Manage WebHooks integration sends a merge request event File: webhook_events_spec.rb	153	0%

Plan (6)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions File: epics_management_spec.rb	370	0	0%

Executions table (5)

NAME	RUNS	FAILURE RATE
Name: Plan Testing project wiki can delete a page with spaces in the path File: project_based_page_deletion_spec.rb	371	0%
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb	371	0%
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb	371	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb	371	0%
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page with spaces File: project_based_content_manipulation_spec.rb	371	0%

Verify (9)

Executions table (2)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly File: pipeline_with_image_pull_policy_spec.rb	371	0	0%
Name: Verify CI catalog when sorting with released at behaves like descending order by default displays from last to first File: ci_catalog_sorting_spec.rb	153	0	0%

Executions table (7)

NAME	RUNS	FAILURE RATE
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	153	0%
Name: Verify when pipeline is blocked can still merge MR successfully File: merge_mr_when_pipline_is_blocked_spec.rb	153	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	152	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	152	0%
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	152	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	119	0%
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	112	0%

Blocking specs with failures (2024-09-09 - 2024-09-23)

Note:

Only failures from the nightly, e2e-test-on-omnibus and e2e-test-on-gdk pipelines are considered
Only specs that have a failure rate of equal or greater than 1 percent are considered
Quarantine MRs will be created for all specs listed below

Total amount: 3

STAGE	COUNT
plan	1
secure	1
systems	1

Plan (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Plan Testing group wiki file upload by creating a formatted page with an image uploaded File: file_upload_group_wiki_page_spec.rb Exceptions: - `element not interactable (Session info: chrome=123.0.6312.105)` - `Unable to find visible css ".gl-new-dropdown-contents li" with text "Heading 1" within #<Capybara::Node::Element tag="div" path="/HTML/BODY[1]/DIV[2]/DIV[2]/DIV[4]/MAIN[1]/DIV[1]/FORM[1]/DIV[3]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]">` - `Unable to find visible css ".gl-new-dropdown-contents li" with text "Heading 1" within #<Capybara::Node::Element tag="div" path="/HTML/BODY[1]/DIV[1]/DIV[3]/DIV[4]/MAIN[1]/DIV[1]/FORM[1]/DIV[3]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]">` - `Unable to find visible css ".gl-new-dropdown-contents li" with text "Heading 1" within #<Capybara::Node::Element tag="div" path="/HTML/BODY[1]/DIV[1]/DIV[2]/DIV[4]/MAIN[1]/DIV[1]/FORM[1]/DIV[3]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[1]/DIV[...`	512	7	1.37%

Secure (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Secure when Advanced SAST is enabled finds a vulnerability File: enable_advanced_sast_spec.rb Exceptions: - `expected 'QA::EE::Page::Project::Secure::PipelineSecurity.has_vulnerability?("Uncontrolled resource consumption")' to be truthy, got false` - `Wait for latest pipeline failed after 90 seconds`	358	10	2.79%

Systems (1)

Executions table (1)

NAME	RUNS	FAILURES	FAILURE RATE
Name: Systems Gitaly Cluster replication queue allows replication of different repository after interruption File: praefect_replication_queue_spec.rb Exceptions: - `The command HOME="/tmp/qa-netrc-credentials/19" git push --all 2>&1 failed (1) with the following output:error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504send-pack: unexpected disconnect while reading sideband packetfatal: ...` - `The command HOME="/tmp/qa-netrc-credentials/19" git push --all 2>&1 failed (1) with the following output:error: RPC failed; HTTP 500 curl 22 The requested URL returned error: 500send-pack: unexpected disconnect while reading sideband packetfatal: ...`	149	4	2.68%