Reliable e2e test report
- Candidates for promotion to reliable (2023-11-27 - 2023-12-11)
- Reliable specs with failures (2023-11-27 - 2023-12-11)
Candidates for promotion to reliable (2023-11-27 - 2023-12-11)
Total amount: 194
STAGE | COUNT |
---|---|
analytics | 2 |
create | 65 |
data_stores | 21 |
fulfillment | 2 |
govern | 30 |
manage | 2 |
package | 27 |
plan | 23 |
release | 5 |
secure | 2 |
verify | 15 |
Analytics (2)
Executions table groupproduct analytics (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests File: performance_bar_spec.rb |
13 | 0 | 0% |
Executions table groupanalytics instrumentation (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled File: service_ping_default_enabled_spec.rb |
19 | 0 | 0% |
Create (65)
Executions table groupide (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb |
19 | 0 | 0% |
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb |
19 | 0 | 0% |
Name: Create Closing Web IDE shows an alert when there are unsaved changes File: closing_web_ide_with_unsaved_changes_spec.rb |
19 | 0 | 0% |
Executions table groupsource code (56)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb |
19 | 0 | 0% |
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb |
19 | 0 | 0% |
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb |
19 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
19 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
19 | 0 | 0% |
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb |
19 | 0 | 0% |
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb |
19 | 0 | 0% |
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb |
19 | 0 | 0% |
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb |
19 | 0 | 0% |
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb |
19 | 0 | 0% |
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb |
19 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb |
19 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb |
19 | 0 | 0% |
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb |
19 | 0 | 0% |
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb |
19 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
19 | 0 | 0% |
Name: Create PostReceive idempotent pushes and creates a single push event three times File: push_postreceive_idempotent_spec.rb |
19 | 0 | 0% |
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Project templates when group level successfully imports the project using template File: project_templates_spec.rb |
19 | 0 | 0% |
Name: Create Project templates when instance level successfully imports the project using template File: project_templates_spec.rb Exceptions: - Page did not fully load. This could be due to an unending async request or loading icon.
|
19 | 0 | 0% |
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts commit by message format File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb |
19 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb |
19 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository File: push_mirroring_over_http_spec.rb |
19 | 0 | 0% |
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb |
19 | 0 | 0% |
Name: Create Push over SSH using Git protocol version 2 user pushes to the repository File: protocol_v2_push_ssh_spec.rb |
19 | 0 | 0% |
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
19 | 0 | 0% |
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
19 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
19 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
19 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
19 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
19 | 0 | 0% |
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
19 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
19 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
19 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
19 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
19 | 0 | 0% |
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb |
19 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI File: clone_push_pull_personal_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI File: clone_push_pull_personal_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb |
19 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
18 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
18 | 0 | 0% |
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb |
13 | 0 | 0% |
Executions table groupcode review (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb |
19 | 0 | 0% |
Name: Create Create a new merge request creates a merge request with a milestone and label File: create_merge_request_spec.rb |
19 | 0 | 0% |
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb |
19 | 0 | 0% |
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb |
19 | 0 | 0% |
Name: Create Merge request rebasing user rebases source branch of merge request File: rebase_merge_request_spec.rb |
19 | 0 | 0% |
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb |
19 | 0 | 0% |
Data_stores (21)
Executions table grouptenant scale (11)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API File: user_inherited_access_spec.rb |
19 | 0 | 0% |
Name: Data Stores Group member access request generates a todo item for the group owner File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores Subgroup transfer transfers a subgroup to another group File: transfer_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores User can be followed and their activity seen File: follow_user_activity_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to parent group is allowed to edit the sub-group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to edit the parent group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Executions table groupglobal search (10)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb |
110 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb |
58 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb |
58 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb |
58 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb |
58 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb |
58 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb |
58 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after push File: elasticsearch_reindexing_spec.rb |
52 | 0 | 0% |
Name: Data Stores Search using Elasticsearch tests reindexing after webIDE File: elasticsearch_reindexing_spec.rb |
52 | 0 | 0% |
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb |
52 | 0 | 0% |
Fulfillment (2)
Executions table groupprovision (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Active license details shows up in subscription page File: license_spec.rb |
13 | 0 | 0% |
Executions table groupsubscription management (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb |
13 | 0 | 0% |
Govern (30)
Executions table groupcompliance (7)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned File: compliance_pipeline_spec.rb |
19 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with no destination adds a streaming destination File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a group is created the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Executions table groupauthentication (15)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Group access token can be used to commit via the API File: group_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern Group access token can be used to create a file via the project API File: group_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern Project access token for a different project cannot be used to commit via the API File: project_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern Project access token for a different project cannot be used to create a file via the project API File: project_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern Project access token for the same project can be used to commit via the API File: project_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern Project access token for the same project can be used to create a file via the project API File: project_access_token_spec.rb |
19 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to commit via the API File: minimal_access_user_spec.rb |
19 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to create a file via the API File: minimal_access_user_spec.rb |
19 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to edit files via the UI File: minimal_access_user_spec.rb |
19 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to push code via the CLI File: minimal_access_user_spec.rb |
19 | 0 | 0% |
Name: Govern Group access tokens can be created and revoked via the UI File: group_access_token_spec.rb |
13 | 0 | 0% |
Name: Govern Impersonation tokens can be created and revoked via the UI File: impersonation_token_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to commit via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI File: user_access_termination_spec.rb |
13 | 0 | 0% |
Executions table groupthreat insights (8)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb |
19 | 0 | 0% |
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb |
19 | 0 | 0% |
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb |
19 | 0 | 0% |
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb |
19 | 0 | 0% |
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb |
19 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb |
19 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb |
19 | 0 | 0% |
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb |
13 | 0 | 0% |
Manage (2)
Executions table groupimport and integrate (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb |
13 | 0 | 0% |
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb |
13 | 0 | 0% |
Package (27)
Executions table grouppackage registry (27)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Conan Repository publishes, installs, and deletes a Conan package File: conan_repository_spec.rb |
19 | 0 | 0% |
Name: Package Generic Repository uploads a generic package and downloads it File: generic_repository_spec.rb |
19 | 0 | 0% |
Name: Package Helm Registry using ci job token pushes and pulls a helm chart File: helm_registry_spec.rb |
19 | 0 | 0% |
Name: Package Helm Registry using personal access token pushes and pulls a helm chart File: helm_registry_spec.rb |
19 | 0 | 0% |
Name: Package Helm Registry using project deploy token pushes and pulls a helm chart File: helm_registry_spec.rb |
19 | 0 | 0% |
Name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
19 | 0 | 0% |
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
19 | 0 | 0% |
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
19 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates File: maven_group_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package File: maven_group_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package File: maven_group_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package File: maven_group_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
19 | 0 | 0% |
Name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
19 | 0 | 0% |
Name: Package NuGet project level endpoint using a ci job token publishes a nuget package and installs File: nuget_project_level_spec.rb |
19 | 0 | 0% |
Name: Package Terraform Module Registry publishes a module File: terraform_module_registry_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI File: npm_group_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI File: npm_group_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI File: npm_group_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI File: npm_instance_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI File: npm_instance_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI File: npm_instance_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI File: npm_project_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI File: npm_project_level_spec.rb |
19 | 0 | 0% |
Name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI File: npm_project_level_spec.rb |
19 | 0 | 0% |
Plan (23)
Executions table groupknowledge (13)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan A project wiki can change the directory path of a page File: project_based_directory_management_spec.rb |
19 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb |
19 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb |
19 | 0 | 0% |
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb |
19 | 0 | 0% |
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb |
19 | 0 | 0% |
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb |
19 | 0 | 0% |
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb |
19 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb |
19 | 0 | 0% |
Executions table groupproject management (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb |
19 | 0 | 0% |
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb |
19 | 0 | 0% |
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb |
19 | 0 | 0% |
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb |
19 | 0 | 0% |
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb |
19 | 0 | 0% |
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb |
19 | 0 | 0% |
Executions table groupproduct planning (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Design Management user adds a design and annotates it File: add_design_content_spec.rb |
19 | 0 | 0% |
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb |
19 | 0 | 0% |
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb |
19 | 0 | 0% |
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb |
19 | 0 | 0% |
Release (5)
Executions table groupenvironments (5)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Release Deploy key creation user adds a deploy key File: add_deploy_key_spec.rb |
19 | 0 | 0% |
Name: Release Deploy token creation user adds a deploy token File: add_deploy_token_spec.rb |
19 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
19 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
19 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
19 | 0 | 0% |
Secure (2)
Executions table groupstatic analysis (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
19 | 0 | 0% |
Name: Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
19 | 0 | 0% |
Verify (15)
Executions table grouprunner (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Group runner registration user registers a new group runner File: register_group_runner_spec.rb |
19 | 0 | 0% |
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb |
19 | 0 | 0% |
Name: Verify Runner registration user registers a new project runner File: register_runner_spec.rb |
19 | 0 | 0% |
Executions table grouppipeline security (8)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb |
19 | 0 | 0% |
Name: Verify Project artifacts when user tries bulk deletion successfully delete them File: user_can_bulk_delete_artifacts_spec.rb |
19 | 0 | 0% |
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
19 | 0 | 0% |
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
19 | 0 | 0% |
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
19 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
19 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
19 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb Exceptions: - Fabrication of QA::Resource::Project using the API failed (502) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1, maximum-scale=1" name="viewport"> <title>500 Error - GitLab</title> <style>body{align-items:ce...
|
19 | 0 | 0% |
Executions table grouppipeline execution (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb |
19 | 0 | 0% |
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb |
19 | 0 | 0% |
Executions table grouppipeline authoring (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb |
19 | 0 | 0% |
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb |
19 | 0 | 0% |
Reliable specs with failures (2023-11-27 - 2023-12-11)
Total amount: 54
STAGE | COUNT |
---|---|
create | 8 |
data_stores | 6 |
govern | 15 |
monitor | 3 |
plan | 11 |
verify | 11 |
Create (8)
Executions table groupsource code (7)
Executions table groupcode review (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create new merge request from the event notification after a push via the API creates a merge request File: create_merge_request_from_push_notification_spec.rb Exceptions: - Fabrication of QA::Resource::Sandbox using the API failed (400) with '{"message":"Failed to save group {:path=>[\"has already been taken\"]}"}'.Correlation Id: 7659169fc0d6dd58686d4d08f656d0f6Sentry Url: https://new-sentry.gitlab.net/organizations... - Wait failed after 60 seconds
|
293 | 2 | 0.68% |
Data_stores (6)
Executions table grouptenant scale (6)
Govern (15)
Executions table groupauthentication (1)
Executions table groupcompliance (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Group for change project creation level behaves like audit event logs audit events for UI operations File: group_audit_logs_2_spec.rb Exceptions: - Wait failed after 60 seconds
|
295 | 1 | 0.34% |
Name: Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations File: group_audit_logs_2_spec.rb Exceptions: - Wait failed after 60 seconds
|
295 | 1 | 0.34% |
Name: Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations File: group_audit_logs_2_spec.rb Exceptions: - Wait failed after 60 seconds
|
295 | 1 | 0.34% |
Name: Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations File: group_audit_logs_2_spec.rb Exceptions: - Wait failed after 60 seconds
|
295 | 1 | 0.34% |
Executions table groupsecurity policies (4)
Executions table groupthreat insights (6)
Monitor (3)
Executions table grouprespond (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb Exceptions: - Wait failed after 60 seconds
|
294 | 2 | 0.68% |
Name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb Exceptions: - Wait failed after 60 seconds
|
294 | 2 | 0.68% |
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb Exceptions: - expected QA::Page::Project::Monitor::Alerts::Index to have alert with title "Et ut corrupti est." - RSpec::Expectations::MultipleExpectationsNotMetError
|
293 | 2 | 0.68% |
Plan (11)
Executions table groupproject management (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Project milestone creates a project milestone File: create_project_milestone_spec.rb Exceptions: - element not interactable: element has zero size (Session info: headless chrome=113.0.5672.126)
|
295 | 3 | 1.02% |
Name: Plan Custom email customizes email with additional text File: custom_email_spec.rb Exceptions: - Wait failed after 60 seconds
|
189 | 1 | 0.53% |
Executions table groupoptimize (3)
Executions table groupproduct planning (5)
Executions table groupknowledge (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Testing project wiki file upload by creating a formatted page with an image uploaded File: project_based_file_upload_spec.rb Exceptions: - Fabrication of QA::Resource::Wiki::ProjectPage using the API failed (400) with '{"message":{"base":["13:update reference: running pre-receive hooks: GitLab: Internal API error (503)."]}}'.Correlation Id: 92350a5772a2dff0724c0ef3d827218eSentry Url:... - Unable to find css "[data-testid=\"wiki-title-textbox\"],[data-qa-selector=\"wiki-title-textbox\"]"
|
282 | 1 | 0.35% |
Verify (11)
Executions table grouppipeline security (3)
Executions table grouppipeline authoring (4)
Executions table grouppipeline execution (3)
Executions table grouprunner (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Runner fleet management shows group runner counts File: group_runner_counts_spec.rb Exceptions: - Unable to find css "[data-testid=\"runner-count-group\"],[data-qa-selector=\"runner-count-group\"]"
|
293 | 1 | 0.34% |