Reliable e2e test report
- Candidates for promotion to reliable (2023-10-09 - 2023-10-23)
- Reliable specs with failures (2023-10-09 - 2023-10-23)
Candidates for promotion to reliable (2023-10-09 - 2023-10-23)
Total amount: 226
STAGE | COUNT |
---|---|
analytics | 2 |
create | 83 |
data_stores | 23 |
fulfillment | 2 |
govern | 25 |
manage | 2 |
monitor | 3 |
package | 27 |
plan | 23 |
release | 5 |
secure | 1 |
verify | 30 |
analytics (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled File: service_ping_default_enabled_spec.rb |
22 | 0 | 0% |
Name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests File: performance_bar_spec.rb |
13 | 0 | 0% |
create (83)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create API basics raw file access sets no-cache headers as expected File: files_spec.rb |
22 | 0 | 0% |
Name: Create API basics user creates a project with a file and deletes them afterwards File: files_spec.rb |
22 | 0 | 0% |
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb |
22 | 0 | 0% |
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb |
22 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb |
22 | 0 | 0% |
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb |
22 | 0 | 0% |
Name: Create Codeowners displays owners specified in CODEOWNERS file File: code_owners_spec.rb |
22 | 0 | 0% |
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb |
22 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
22 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
22 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
22 | 0 | 0% |
Name: Create Create a new merge request creates a merge request with a milestone and label File: create_merge_request_spec.rb |
22 | 0 | 0% |
Name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches File: add_list_delete_branches_spec.rb |
22 | 0 | 0% |
Name: Create File Locking checks file locked by other user to be disabled File: file_locking_spec.rb |
22 | 0 | 0% |
Name: Create File Locking creates a merge request and fails to merge File: file_locking_spec.rb |
22 | 0 | 0% |
Name: Create File Locking locks a directory and tries to push as a second user File: file_locking_spec.rb |
22 | 0 | 0% |
Name: Create File Locking locks a file and tries to push as a second user File: file_locking_spec.rb |
22 | 0 | 0% |
Name: Create File Locking locks a file and unlocks in list File: file_locking_spec.rb |
22 | 0 | 0% |
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb |
22 | 0 | 0% |
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb |
22 | 0 | 0% |
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb |
22 | 0 | 0% |
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb |
22 | 0 | 0% |
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb |
22 | 0 | 0% |
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb |
22 | 0 | 0% |
Name: Create Git clone over HTTP user performs a deep clone File: clone_spec.rb |
22 | 0 | 0% |
Name: Create Git clone over HTTP user performs a shallow clone File: clone_spec.rb |
22 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb |
22 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb |
22 | 0 | 0% |
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb |
22 | 0 | 0% |
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb |
22 | 0 | 0% |
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb |
22 | 0 | 0% |
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb |
22 | 0 | 0% |
Name: Create Merge request rebasing user rebases source branch of merge request File: rebase_merge_request_spec.rb |
22 | 0 | 0% |
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb |
22 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
22 | 0 | 0% |
Name: Create PostReceive idempotent pushes and creates a single push event three times File: push_postreceive_idempotent_spec.rb |
22 | 0 | 0% |
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth File: pull_mirroring_over_http_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts commit by message format File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb |
22 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb |
22 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository File: push_mirroring_over_http_spec.rb |
22 | 0 | 0% |
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb |
22 | 0 | 0% |
Name: Create Push over SSH using Git protocol version 2 user pushes to the repository File: protocol_v2_push_ssh_spec.rb |
22 | 0 | 0% |
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
22 | 0 | 0% |
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
22 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
22 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
22 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
22 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
22 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
22 | 0 | 0% |
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb |
22 | 0 | 0% |
Name: Create Upload a file in Web IDE when a file with the same name already exists throws an error File: upload_new_file_in_web_ide_spec.rb |
22 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is a text file behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
22 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI File: clone_push_pull_personal_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI File: clone_push_pull_personal_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb |
22 | 0 | 0% |
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
13 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
13 | 0 | 0% |
Name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name File: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
Name: Create Default branch name instance setting sets the default branch name for a new project File: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb |
13 | 0 | 0% |
Name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository File: pull_mirroring_over_ssh_with_key_spec.rb |
13 | 0 | 0% |
Name: Create Repository Usage Quota matches cloned repo usage to reported usage File: storage_size_spec.rb |
13 | 0 | 0% |
Name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit File: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
Name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit File: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
data_stores (23)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb |
113 | 0 | 0% |
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description File: advanced_global_advanced_syntax_search_spec.rb |
61 | 0 | 0% |
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name File: advanced_global_advanced_syntax_search_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message File: commit_index_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb |
61 | 0 | 0% |
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb |
52 | 0 | 0% |
Name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API File: user_inherited_access_spec.rb |
22 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API File: user_inherited_access_spec.rb |
22 | 0 | 0% |
Name: Data Stores Group member access request generates a todo item for the group owner File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores Subgroup transfer transfers a subgroup to another group File: transfer_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores User can be followed and their activity seen File: follow_user_activity_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to parent group is allowed to edit the sub-group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to edit the parent group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
fulfillment (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Active license details shows up in subscription page File: license_spec.rb |
13 | 0 | 0% |
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb |
13 | 0 | 0% |
govern (25)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned File: compliance_pipeline_spec.rb |
22 | 0 | 0% |
Name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations File: group_audit_logs_1_spec.rb |
22 | 0 | 0% |
Name: Govern MR security widget checks that dismissed vulnerabilities do not show up File: dismissed_vulnerabilities_in_security_widget_spec.rb |
22 | 0 | 0% |
Name: Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings File: scan_result_policy_vulnerabilities_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports dependency list has empty state File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON File: vulnerability_security_training_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget File: vulnerability_management_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget File: vulnerability_management_spec.rb |
22 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb |
22 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with no destination adds a streaming destination File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a group is created the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a project is created the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a user is created the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb |
13 | 0 | 0% |
manage (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb |
13 | 0 | 0% |
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb |
13 | 0 | 0% |
monitor (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb |
22 | 0 | 0% |
Name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb |
22 | 0 | 0% |
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb |
22 | 0 | 0% |
package (27)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Conan Repository publishes, installs, and deletes a Conan package File: conan_repository_spec.rb |
22 | 0 | 0% |
Name: Package Generic Repository uploads a generic package and downloads it File: generic_repository_spec.rb |
22 | 0 | 0% |
Name: Package Helm Registry using ci job token pushes and pulls a helm chart File: helm_registry_spec.rb |
22 | 0 | 0% |
Name: Package Helm Registry using personal access token pushes and pulls a helm chart File: helm_registry_spec.rb |
22 | 0 | 0% |
Name: Package Helm Registry using project deploy token pushes and pulls a helm chart File: helm_registry_spec.rb |
22 | 0 | 0% |
Name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
22 | 0 | 0% |
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
22 | 0 | 0% |
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
22 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates File: maven_group_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package File: maven_group_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package File: maven_group_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package File: maven_group_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
22 | 0 | 0% |
Name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
22 | 0 | 0% |
Name: Package PyPI Repository when at the project level publishes and installs a pypi package File: pypi_repository_spec.rb |
22 | 0 | 0% |
Name: Package RubyGems Repository publishes a Ruby gem File: rubygems_registry_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI File: npm_group_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI File: npm_group_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI File: npm_group_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI File: npm_instance_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI File: npm_instance_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI File: npm_instance_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI File: npm_project_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI File: npm_project_level_spec.rb |
22 | 0 | 0% |
Name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI File: npm_project_level_spec.rb |
22 | 0 | 0% |
plan (23)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan A project wiki can change the directory path of a page File: project_based_directory_management_spec.rb |
22 | 0 | 0% |
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb |
22 | 0 | 0% |
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb |
22 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb |
22 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb |
22 | 0 | 0% |
Name: Plan Design Management user adds a design and annotates it File: add_design_content_spec.rb |
22 | 0 | 0% |
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb |
22 | 0 | 0% |
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb |
22 | 0 | 0% |
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb |
22 | 0 | 0% |
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb |
22 | 0 | 0% |
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb |
22 | 0 | 0% |
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb |
22 | 0 | 0% |
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb |
22 | 0 | 0% |
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb |
22 | 0 | 0% |
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb |
22 | 0 | 0% |
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb |
22 | 0 | 0% |
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb |
22 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb |
22 | 0 | 0% |
release (5)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Release Deploy key creation user adds a deploy key File: add_deploy_key_spec.rb |
22 | 0 | 0% |
Name: Release Deploy token creation user adds a deploy token File: add_deploy_token_spec.rb |
22 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
secure (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
22 | 0 | 0% |
verify (30)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Include multiple files from a project runs the pipeline with composed config File: include_multiple_files_from_a_project_spec.rb |
22 | 0 | 0% |
Name: Verify Job artifacts are not downloaded when dependencies array is set to empty File: job_downloads_artifacts_spec.rb |
22 | 0 | 0% |
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message File: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined File: prefill_variables_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page File: prefill_variables_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with project file variables can read file variable content with cat File: file_variable_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with project file variables does not expose file variable content with echo File: file_variable_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with protected variable does not expose variable on unprotected branch File: pipeline_with_protected_variable_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with protected variable exposes variable on protected branch File: pipeline_with_protected_variable_spec.rb |
22 | 0 | 0% |
Name: Verify Pipeline with raw variables in YAML expands variables according to expand: true/false File: raw_variables_defined_in_yaml_spec.rb |
22 | 0 | 0% |
Name: Verify Project artifacts when user tries bulk deletion successfully delete them File: user_can_bulk_delete_artifacts_spec.rb |
22 | 0 | 0% |
Name: Verify Run pipeline with manual jobs does not leave any job in skipped state File: run_pipeline_with_manual_jobs_spec.rb |
22 | 0 | 0% |
Name: Verify Runner fleet management shows group runner counts File: group_runner_counts_spec.rb |
22 | 0 | 0% |
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb |
22 | 0 | 0% |
Name: Verify Runner registration user registers a new project runner File: register_runner_spec.rb |
22 | 0 | 0% |
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb |
22 | 0 | 0% |
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb |
22 | 0 | 0% |
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
22 | 0 | 0% |
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
22 | 0 | 0% |
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family File: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
22 | 0 | 0% |
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb |
22 | 0 | 0% |
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb |
22 | 0 | 0% |
Reliable specs with failures (2023-10-09 - 2023-10-23)
Total amount: 21
STAGE | COUNT |
---|---|
create | 6 |
data_stores | 6 |
govern | 6 |
verify | 3 |
create (6)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Cherry picking from a merge request creates a merge request File: cherry_pick_a_merge_spec.rb Exceptions: - Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"
|
354 | 1 | 0.28% |
Name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push File: push_protected_branch_spec.rb Exceptions: - expected QA::Support::Run::CommandError with message matching /You are not allowed to push code to protected branches on this project\.([\s\S]+)\[remote rejected\] protected-branch -> protected-branch \(pre-receive hook declined\)/ but nothing was...
|
354 | 1 | 0.28% |
Name: Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user File: protected_tags_spec.rb Exceptions: - Unable to find css "[data-testid=\"new_tag_button\"],[data-qa-selector=\"new_tag_button\"]"
|
354 | 1 | 0.28% |
Name: Create Reverting a commit creates a merge request File: revert_commit_spec.rb Exceptions: - Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"
|
354 | 1 | 0.28% |
Name: Create new merge request from the event notification after a push via the API creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Wait failed after 60 seconds
|
354 | 1 | 0.28% |
Name: Create new merge request from the event notification after a push via the git CLI creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Wait failed after 60 seconds
|
354 | 1 | 0.28% |
data_stores (6)
Executions table
govern (6)
Executions table
verify (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes File: parent_child_pipelines_dependent_relationship_spec.rb Exceptions: - Waiting for linked pipeline to appear failed after 3 attempts
|
354 | 1 | 0.28% |
Name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results File: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Wait failed after 120 seconds
|
354 | 1 | 0.28% |
Name: Verify Pipelines for merged results and merge trains merges via a merge train File: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Wait failed after 120 seconds
|
354 | 1 | 0.28% |