Reliable e2e test report
- Candidates for promotion to reliable/blocking (2024-01-22 - 2024-02-05)
- Reliable specs with failures (2024-01-22 - 2024-02-05)
Candidates for promotion to reliable/blocking (2024-01-22 - 2024-02-05)
Note: MRs will be auto-created for promoting the top 10 specs sorted by most number of successful runs
Total amount: 172
STAGE | COUNT |
---|---|
analytics | 1 |
data_stores | 12 |
create | 63 |
fulfillment | 2 |
monitor | 6 |
govern | 24 |
manage | 26 |
package | 5 |
plan | 14 |
systems | 7 |
verify | 12 |
Analytics (1)
Executions table groupanalytics instrumentation (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Service ping disabled when disabled from gitlab.yml config has service ping toggle is disabled File: service_ping_disabled_spec.rb |
132 | 0 | 0% |
Data_stores (12)
Executions table grouptenant scale (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Configure Mattermost support user creates a group with a mattermost team File: create_group_with_mattermost_team_spec.rb |
132 | 0 | 0% |
Executions table groupglobal search (11)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: elasticsearch_api_spec.rb |
256 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message File: commit_index_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb |
191 | 0 | 0% |
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb |
184 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after webIDE File: elasticsearch_reindexing_spec.rb |
184 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after push File: elasticsearch_reindexing_spec.rb |
184 | 0 | 0% |
Create (63)
Executions table groupsource code (50)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts commit by message format File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb |
561 | 0 | 0% |
Name: Create API basics user creates a project with a file and deletes them afterwards File: files_spec.rb |
560 | 0 | 0% |
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb |
560 | 0 | 0% |
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
560 | 0 | 0% |
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb |
560 | 0 | 0% |
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb |
559 | 0 | 0% |
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb |
559 | 0 | 0% |
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb |
559 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb |
559 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb |
559 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb Exceptions: - Page did not fully load. This could be due to an unending async request or loading icon.
|
559 | 0 | 0% |
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb |
559 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb |
559 | 0 | 0% |
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb |
559 | 0 | 0% |
Name: Create Project templates when built-in successfully imports the project using template File: project_templates_spec.rb |
559 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
559 | 0 | 0% |
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
559 | 0 | 0% |
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb |
559 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb |
559 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb |
559 | 0 | 0% |
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb |
559 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
559 | 0 | 0% |
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
559 | 0 | 0% |
Name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository File: pull_mirroring_over_ssh_with_key_spec.rb |
559 | 0 | 0% |
Name: Create Project templates when instance level successfully imports the project using template File: project_templates_spec.rb |
559 | 0 | 0% |
Name: Create Project templates when group level successfully imports the project using template File: project_templates_spec.rb |
559 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
558 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
558 | 0 | 0% |
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb |
558 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb |
558 | 0 | 0% |
Name: Create Create a new project from a template commits via the api File: commit_to_templated_project_spec.rb |
557 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
557 | 0 | 0% |
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb |
557 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
557 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
557 | 0 | 0% |
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb |
557 | 0 | 0% |
Name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth File: pull_mirroring_over_http_spec.rb |
556 | 0 | 0% |
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb |
556 | 0 | 0% |
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb |
555 | 0 | 0% |
Name: Create Gitaly repository storage creates a 2nd fork after moving the parent project File: move_project_create_fork_spec.rb |
132 | 0 | 0% |
Name: Create Snippet repository storage moves snippet repository from one Gitaly storage to another File: snippet_repository_storage_move_spec.rb |
132 | 0 | 0% |
Executions table groupide (8)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Closing Web IDE shows an alert when there are unsaved changes File: closing_web_ide_with_unsaved_changes_spec.rb |
559 | 0 | 0% |
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb |
557 | 0 | 0% |
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb |
557 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is an image behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
555 | 0 | 0% |
Name: Create Upload a file in Web IDE when a file with the same name already exists throws an error File: upload_new_file_in_web_ide_spec.rb |
555 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is a text file behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
555 | 0 | 0% |
Name: Create Add first file in Web IDE when user adds a new file shows successfully added and visible in project File: add_first_file_in_web_ide_spec.rb |
549 | 0 | 0% |
Name: Create Add first file in Web IDE when a file with the same name already exists throws an error File: add_first_file_in_web_ide_spec.rb |
549 | 0 | 0% |
Executions table groupcode review (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb |
560 | 0 | 0% |
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb |
559 | 0 | 0% |
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb |
558 | 0 | 0% |
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb |
558 | 0 | 0% |
Executions table ~"group::editor" (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Group Wiki repository storage moves group Wiki repository from one Gitaly storage to another File: group_wiki_repository_storage_move_spec.rb |
132 | 0 | 0% |
Fulfillment (2)
Executions table groupprovision (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Cloud activation code activates instance with correct subscription details File: cloud_activation_spec.rb |
132 | 0 | 0% |
Executions table groupsubscription management (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb |
419 | 0 | 0% |
Monitor (6)
Executions table groupobservability (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: GitLab Metrics Sidekiq metrics via dedicated server returns 200 OK and serves metrics File: metrics_spec.rb |
131 | 0 | 0% |
Name: GitLab Metrics Web metrics via dedicated server returns 200 OK and serves metrics File: metrics_spec.rb |
131 | 0 | 0% |
Executions table grouprespond (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Monitor Alert when user is a maintainer when using HTTP endpoint integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb |
132 | 0 | 0% |
Name: Monitor Alert when user is a maintainer when using Prometheus integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb |
132 | 0 | 0% |
Name: Monitor Alert when user is an owner when using HTTP endpoint integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb |
132 | 0 | 0% |
Name: Monitor Alert when user is an owner when using Prometheus integration behaves like notification on new alert sends email to user File: email_notification_for_alert_spec.rb |
132 | 0 | 0% |
Govern (24)
Executions table groupauthentication (20)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern User with minimal access to group is not allowed to push code via the CLI File: minimal_access_user_spec.rb |
427 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI File: user_access_termination_spec.rb |
417 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API File: user_access_termination_spec.rb |
417 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to commit via the API File: user_access_termination_spec.rb |
417 | 0 | 0% |
Name: Govern LDAP Group sync with group cn method behaves like Group sync can create project access tokens File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP Group sync with group cn method behaves like Group sync can create group access tokens File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP login user logs into GitLab using LDAP credentials File: log_into_gitlab_via_ldap_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP Group sync with user filter method behaves like Group sync can create project access tokens File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP Group sync with user filter method behaves like Group sync has LDAP users synced File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP Group sync with group cn method behaves like Group sync has LDAP users synced File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern LDAP Group sync with user filter method behaves like Group sync can create group access tokens File: group_ldap_sync_spec.rb |
263 | 0 | 0% |
Name: Govern Instance wide SAML SSO user logs in to gitlab with SAML SSO File: login_via_instance_wide_saml_sso_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Non enforced SSO when SAML SSO is configured with a default membership role adds the new member with access level as set in SAML SSO configuration File: group_saml_non_enforced_sso_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Non enforced SSO lets group admin test settings File: group_saml_non_enforced_sso_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking disabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Enforced SSO user clones and pushes to project within a group using Git HTTP File: group_saml_enforced_sso_git_access_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Enforced SSO with Snowplow tracking enabled behaves like group membership actions creates a new account automatically and allows to leave group and join again File: group_saml_enforced_sso_new_account_spec.rb |
132 | 0 | 0% |
Name: Govern Group SAML SSO - Non enforced SSO user logs in to group with SAML SSO File: group_saml_non_enforced_sso_spec.rb |
132 | 0 | 0% |
Name: Govern Mattermost login user logs into Mattermost using GitLab OAuth File: log_into_mattermost_via_gitlab_spec.rb |
132 | 0 | 0% |
Name: Govern while LDAP is enabled behaves like registration and login allows the user to register and login File: register_spec.rb |
131 | 0 | 0% |
Executions table groupthreat insights (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget File: vulnerability_management_spec.rb |
421 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb |
421 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb |
421 | 0 | 0% |
Name: Govern vulnerability report with jira integration can successfully create a JIRA issue from vulnerability details page File: vulnerabilities_jira_integration_spec.rb |
132 | 0 | 0% |
Manage (26)
Executions table groupimport and integrate (26)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb |
419 | 0 | 0% |
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb |
418 | 0 | 0% |
Name: Manage WebHooks integration sends a wiki page event File: webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage WebHooks integration sends a tag event File: webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage Jira integration closes an issue via a merge request File: jira_basic_integration_spec.rb |
132 | 0 | 0% |
Name: Manage WebHooks integration sends an issues and note event File: webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage WebHooks integration sends a push event File: webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage Pipeline status emails when pipeline passes sends an email File: pipeline_status_emails_spec.rb |
132 | 0 | 0% |
Name: Manage Pipeline status emails when pipeline fails sends an email File: pipeline_status_emails_spec.rb |
132 | 0 | 0% |
Name: Manage WebHooks integration sends a merge request event File: webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage Jira issues integration shows open issues File: jira_issues_list_spec.rb |
132 | 0 | 0% |
Name: Manage Jira issues integration views an issue File: jira_issues_list_spec.rb |
132 | 0 | 0% |
Name: Manage Group WebHooks integration sends subgroup events File: group_webhook_events_spec.rb |
132 | 0 | 0% |
Name: Manage Jira integration closes an issue via pushing a commit File: jira_basic_integration_spec.rb |
132 | 0 | 0% |
Name: Manage Jira issues integration searching issues returns results File: jira_issues_list_spec.rb |
132 | 0 | 0% |
Name: Manage Gitlab migration with uninitialized project successfully imports project File: gitlab_migration_project_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with release successfully imports project release File: gitlab_migration_release_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with wiki successfully imports project wiki File: gitlab_migration_project_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with group member member retains indirect membership in imported project File: gitlab_migration_members_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with project issues successfully imports issue File: gitlab_migration_issue_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with ci pipeline successfully imports ci pipeline File: gitlab_migration_pipeline_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with EE features imports group epics and iterations File: gitlab_migration_group_spec.rb |
131 | 0 | 0% |
Name: Manage GitHub import when imported via api imports repo push rules File: import_github_repo_spec.rb Exceptions: - Fabrication of QA::Resource::ProjectImportedFromGithub using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01HMR2NQMNJE0B9H50NDV8DXB7 - Fabrication of QA::Resource::ProjectImportedFromGithub using the API failed (500) with '{"message":"500 Internal Server Error"}'.Correlation Id: 01HNCMVH4NV84YH2WX6MBWFPD6
|
131 | 0 | 0% |
Name: Manage Gitlab migration with associated merge request preserves related merge request File: gitlab_migration_issue_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with designs successfully imports design File: gitlab_migration_issue_spec.rb |
131 | 0 | 0% |
Name: Manage Gitlab migration with project member member retains direct membership in imported project File: gitlab_migration_members_spec.rb |
131 | 0 | 0% |
Package (5)
Executions table grouppackage registry (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
825 | 0 | 0% |
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
825 | 0 | 0% |
Name: Package PyPI Repository when at the project level publishes and installs a pypi package File: pypi_repository_spec.rb |
823 | 0 | 0% |
Name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
822 | 0 | 0% |
Executions table groupcontainer registry (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Dependency Proxy Group SSO pulls an image using the dependency proxy on a group enforced SSO File: dependency_proxy_sso_spec.rb |
132 | 0 | 0% |
Plan (14)
Executions table groupknowledge (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb |
428 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb |
428 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb |
428 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb |
428 | 0 | 0% |
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb |
426 | 0 | 0% |
Name: Plan Testing group wiki file upload by creating a formatted page with an image uploaded File: file_upload_group_wiki_page_spec.rb |
413 | 0 | 0% |
Executions table groupproject management (5)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb |
427 | 0 | 0% |
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb |
426 | 0 | 0% |
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb |
426 | 0 | 0% |
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb |
425 | 0 | 0% |
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb |
425 | 0 | 0% |
Executions table groupproduct planning (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb |
428 | 0 | 0% |
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb |
427 | 0 | 0% |
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb |
426 | 0 | 0% |
Systems (7)
Executions table groupgitaly (7)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Systems Changing Gitaly repository storage when moving from one Gitaly storage to another behaves like repository storage move confirms a finished status after moving project repository storageFile: changing_repository_storage_spec.rb |
132 | 0 | 0% |
Name: Systems Gitaly Cluster replication queue allows replication of different repository after interruption File: praefect_replication_queue_spec.rb |
130 | 0 | 0% |
Name: Systems Gitaly backend node recovery recovers from dataloss File: backend_node_recovery_spec.rb |
130 | 0 | 0% |
Name: Systems Gitaly distributed reads reads from each node File: distributed_reads_spec.rb |
130 | 0 | 0% |
Name: Systems Gitaly distributed reads when a node is unhealthy does not read from the unhealthy node File: distributed_reads_spec.rb |
130 | 0 | 0% |
Name: Systems with Gitaly automatic failover and recovery automatically fails over File: automatic_failover_and_recovery_spec.rb |
130 | 0 | 0% |
Name: Systems with Gitaly automatic failover and recovery when recovering from dataloss after failover automatically reconciles File: automatic_failover_and_recovery_spec.rb |
130 | 0 | 0% |
Verify (12)
Executions table grouprunner (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Group runner registration user registers a new group runner File: register_group_runner_spec.rb |
429 | 0 | 0% |
Executions table grouppipeline security (7)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
429 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
429 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
429 | 0 | 0% |
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb Exceptions: - Ambiguous match, found 2 elements matching visible css "[data-testid=\"base-dropdown-toggle\"]" within #<Capybara::Node::Element tag="div" path="/HTML/BODY[1]/DIV[1]/DIV[2]/DIV[3]/MAIN[1]/DIV[2]/DIV[3]/DIV[3]/DIV[2]/DIV[1]/SECTION[1]/DIV[1]/DIV[3]...
|
426 | 0 | 0% |
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
425 | 0 | 0% |
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
425 | 0 | 0% |
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
425 | 0 | 0% |
Executions table grouppipeline execution (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb |
426 | 0 | 0% |
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb |
426 | 0 | 0% |
Executions table grouppipeline authoring (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb |
428 | 0 | 0% |
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb |
425 | 0 | 0% |
Reliable specs with failures (2024-01-22 - 2024-02-05)
Note:
-
Only failures from the nightly, e2e-package-and-test and e2e-test-on-gdk pipelines are considered
-
Only specs that have a failure rate of equal or greater than 1 percent are considered
-
Quarantine MRs will be created for all specs listed below
Total amount: 4
STAGE | COUNT |
---|---|
create | 2 |
package | 1 |
verify | 1 |
Create (2)
Executions table groupsource code (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push File: push_protected_branch_spec.rb Exceptions: - expected QA::Support::Run::CommandError with message matching /You are not allowed to push code to protected branches on this project\.([\s\S]+)\[remote rejected\] protected-branch -> protected-branch \(pre-receive hook declined\)/ but nothing was... - RSpec::Core::MultipleExceptionError - Unable to find css "[data-testid=\"flash-container\"]"
|
1017 | 16 | 1.57% |
Executions table groupcode review (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create new merge request from the event notification after a push via the API creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Wait failed after 60 seconds - RSpec::Core::MultipleExceptionError - Unable to find css "[data-testid=\"flash-container\"]"
|
1017 | 24 | 2.36% |
Package (1)
Executions table grouppackage registry (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package RubyGems Repository publishes a Ruby gem File: rubygems_registry_spec.rb Exceptions: - expected 'QA::Page::Project::Job::Show.successful?({:timeout=>180})' to be truthy, got false - expected QA::Page::Project::Packages::Index to have package "mygem-04d82606ba108050" - RSpec::Core::MultipleExceptionError - expected QA::Page::Project::Packages::Index to have package "mygem-bb95351157a35c7c"
|
1159 | 18 | 1.55% |
Verify (1)
Executions table grouppipeline security (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Pipeline with protected variable exposes variable on protected branch File: pipeline_with_protected_variable_spec.rb Exceptions: - Expect protected variable to be in job log. - Unable to find css "[data-testid=\"flash-container\"]" - RSpec::Core::MultipleExceptionError
|
882 | 13 | 1.47% |