Reliable e2e test report
- Candidates for promotion to reliable (2023-11-06 - 2023-11-20)
- Reliable specs with failures (2023-11-06 - 2023-11-20)
Candidates for promotion to reliable (2023-11-06 - 2023-11-20)
Total amount: 237
STAGE | COUNT |
---|---|
analytics | 2 |
create | 88 |
data_stores | 23 |
fulfillment | 2 |
govern | 38 |
manage | 2 |
monitor | 4 |
package | 34 |
plan | 23 |
release | 5 |
secure | 2 |
verify | 14 |
Analytics (2)
Executions table groupproduct analytics (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests File: performance_bar_spec.rb |
13 | 0 | 0% |
Executions table groupanalytics instrumentation (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled File: service_ping_default_enabled_spec.rb |
20 | 0 | 0% |
Create (88)
Executions table groupsource code (77)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create API basics raw file access sets no-cache headers as expected File: files_spec.rb |
20 | 0 | 0% |
Name: Create API basics user creates a project with a file and deletes them afterwards File: files_spec.rb |
20 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet File: add_comment_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet File: add_comment_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Branch Rules Overview adds a new branch rule File: add_new_branch_rule_spec.rb |
20 | 0 | 0% |
Name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly File: branch_with_unusual_name_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners displays owners specified in CODEOWNERS file File: code_owners_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners merge request assigns code owners as approvers File: assign_code_owners_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
20 | 0 | 0% |
Name: Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different File: project_archive_compare_spec.rb |
20 | 0 | 0% |
Name: Create Create a new project from a template commits via the api File: commit_to_templated_project_spec.rb |
20 | 0 | 0% |
Name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches File: add_list_delete_branches_spec.rb |
20 | 0 | 0% |
Name: Create File Locking checks file locked by other user to be disabled File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File Locking creates a merge request and fails to merge File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File Locking locks a directory and tries to push as a second user File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File Locking locks a file and tries to push as a second user File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File Locking locks a file and unlocks in list File: file_locking_spec.rb |
20 | 0 | 0% |
Name: Create File management user deletes a file via the Web File: delete_file_via_web_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds .gitignore via file template Android File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds .gitlab-ci.yml via file template Julia File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds Dockerfile via file template Python File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 File: add_file_template_spec.rb |
20 | 0 | 0% |
Name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly File: file_with_unusual_name_spec.rb |
20 | 0 | 0% |
Name: Create Git clone over HTTP user performs a deep clone File: clone_spec.rb |
20 | 0 | 0% |
Name: Create Git clone over HTTP user performs a shallow clone File: clone_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitignore file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom .gitlab-ci.yml file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom Dockerfile file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Group file templates creates file via custom LICENSE file template File: group_file_template_spec.rb |
20 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file File: add_file_to_snippet_spec.rb |
20 | 0 | 0% |
Name: Create PostReceive idempotent pushes and creates a single push event three times File: push_postreceive_idempotent_spec.rb |
20 | 0 | 0% |
Name: Create Project snippet creation user creates a project snippet File: create_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when built-in successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when group level successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Project templates when instance level successfully imports the project using template File: project_templates_spec.rb |
20 | 0 | 0% |
Name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth File: pull_mirroring_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository File: pull_mirroring_over_ssh_with_key_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits allows an unrestricted push File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts branches by branch name File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts committing files with secrets File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts files by name and size File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts removal of tag File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using non signed commits restricts users by email format File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules using signed commits restricts to signed commits File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push Rules with commits restricted to verified emails rejects unverified emails File: push_rules_spec.rb |
20 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository File: push_mirroring_lfs_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository File: push_mirroring_over_http_spec.rb |
20 | 0 | 0% |
Name: Create Push over HTTP using Git protocol version 2 user pushes to the repository File: protocol_v2_push_http_spec.rb |
20 | 0 | 0% |
Name: Create Push over SSH using Git protocol version 2 user pushes to the repository File: protocol_v2_push_ssh_spec.rb |
20 | 0 | 0% |
Name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
20 | 0 | 0% |
Name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository File: license_detection_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push File: restrict_push_protected_branch_spec.rb |
20 | 0 | 0% |
Name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled File: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number File: snippet_index_page_spec.rb |
20 | 0 | 0% |
Name: Create Source editor toolbar preview can preview markdown side-by-side while editing File: source_editor_toolbar_spec.rb |
20 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI File: clone_push_pull_personal_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI File: clone_push_pull_personal_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI File: clone_push_pull_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI File: clone_push_pull_project_snippet_spec.rb |
20 | 0 | 0% |
Name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_subgroup_spec.rb |
13 | 0 | 0% |
Name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged File: merge_with_code_owner_in_root_group_spec.rb |
13 | 0 | 0% |
Name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name File: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
Name: Create Default branch name instance setting sets the default branch name for a new project File: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
Name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error File: tag_revision_trigger_prereceive_hook_spec.rb |
13 | 0 | 0% |
Name: Create Repository Usage Quota matches cloned repo usage to reported usage File: storage_size_spec.rb |
13 | 0 | 0% |
Name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit File: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
Name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit File: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
Executions table groupide (5)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error File: add_new_directory_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed File: add_new_directory_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when a file with the same name already exists throws an error File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is a text file behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Name: Create Upload a file in Web IDE when the file is an image behaves like upload a file verifies it successfully uploads and commits to a MR File: upload_new_file_in_web_ide_spec.rb |
20 | 0 | 0% |
Executions table groupcode review (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Create Approval rules allows multiple approval rules with users and groups File: approval_rules_spec.rb |
20 | 0 | 0% |
Name: Create Create a new merge request creates a merge request with a milestone and label File: create_merge_request_spec.rb |
20 | 0 | 0% |
Name: Create Merge request creation from fork can merge source branch from fork into upstream repository File: merge_merge_request_from_fork_spec.rb |
20 | 0 | 0% |
Name: Create Merge request push options sets merge when pipeline succeeds File: push_options_mwps_spec.rb |
20 | 0 | 0% |
Name: Create Merge request rebasing user rebases source branch of merge request File: rebase_merge_request_spec.rb |
20 | 0 | 0% |
Name: Create Merged merge request can be reverted File: reverting_merge_request_spec.rb |
20 | 0 | 0% |
Data_stores (23)
Executions table groupglobal search (11)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user File: nightly_elasticsearch_test_spec.rb |
111 | 0 | 0% |
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description File: advanced_global_advanced_syntax_search_spec.rb |
59 | 0 | 0% |
Name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name File: advanced_global_advanced_syntax_search_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message File: commit_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user File: elasticsearch_api_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user File: elasticsearch_api_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content File: blob_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description File: issue_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description File: merge_request_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body File: note_index_spec.rb |
59 | 0 | 0% |
Name: Data Stores When using advanced search API to search for a user finds the user that matches username File: user_index_spec.rb |
52 | 0 | 0% |
Executions table grouptenant scale (12)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API File: user_inherited_access_spec.rb |
20 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API File: user_inherited_access_spec.rb |
20 | 0 | 0% |
Name: Data Stores Group member access request generates a todo item for the group owner File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group File: group_member_access_request_spec.rb |
13 | 0 | 0% |
Name: Data Stores Group with members can be shared with another group with correct access level File: share_group_with_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores Subgroup transfer transfers a subgroup to another group File: transfer_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores User can be followed and their activity seen File: follow_user_activity_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to parent group is allowed to edit the sub-group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores User when added to sub-group is not allowed to edit the parent group project files File: user_inherited_access_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when disabled allows forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Name: Data Stores prevent forking outside group when enabled does not allow forking outside of group File: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
Fulfillment (2)
Executions table groupprovision (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Active license details shows up in subscription page File: license_spec.rb |
13 | 0 | 0% |
Executions table groupsubscription management (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license File: user_registration_billing_spec.rb |
13 | 0 | 0% |
Govern (38)
Executions table groupauthentication (14)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Group access token can be used to create a file via the project API File: group_access_token_spec.rb |
20 | 0 | 0% |
Name: Govern Project access token for a different project cannot be used to commit via the API File: project_access_token_spec.rb |
20 | 0 | 0% |
Name: Govern Project access token for a different project cannot be used to create a file via the project API File: project_access_token_spec.rb |
20 | 0 | 0% |
Name: Govern Project access token for the same project can be used to create a file via the project API File: project_access_token_spec.rb |
20 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to commit via the API File: minimal_access_user_spec.rb |
20 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to create a file via the API File: minimal_access_user_spec.rb |
20 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to edit files via the UI File: minimal_access_user_spec.rb |
20 | 0 | 0% |
Name: Govern User with minimal access to group is not allowed to push code via the CLI File: minimal_access_user_spec.rb |
20 | 0 | 0% |
Name: Govern 2FA allows enforcing 2FA via UI and logging in with 2FA File: log_in_with_2fa_spec.rb |
13 | 0 | 0% |
Name: Govern Group access tokens can be created and revoked via the UI File: group_access_token_spec.rb |
13 | 0 | 0% |
Name: Govern Impersonation tokens can be created and revoked via the UI File: impersonation_token_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to commit via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to create a file via the API File: user_access_termination_spec.rb |
13 | 0 | 0% |
Name: Govern User when parent group membership is terminated is not allowed to push code via the CLI File: user_access_termination_spec.rb |
13 | 0 | 0% |
Executions table groupcompliance (7)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned File: compliance_pipeline_spec.rb |
20 | 0 | 0% |
Name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations File: group_audit_logs_1_spec.rb |
20 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Group audit event streaming with no destination adds a streaming destination File: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event File: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
Executions table groupsecurity policies (3)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Group Level Scan Execution Policy does not take effect when pipeline is run on non default branch File: scan_execution_policy_vulnerabilities_spec.rb |
20 | 0 | 0% |
Name: Govern Group Level Scan Execution Policy takes effect when pipeline is run on the main branch File: scan_execution_policy_vulnerabilities_spec.rb |
20 | 0 | 0% |
Name: Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings File: scan_result_policy_vulnerabilities_spec.rb |
20 | 0 | 0% |
Executions table groupthreat insights (14)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern MR security widget checks that dismissed vulnerabilities do not show up File: dismissed_vulnerabilities_in_security_widget_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports dependency list has empty state File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays false positives for the vulnerabilities File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays security reports in the group security dashboard File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays security reports in the pipeline File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports displays security reports in the project security dashboard File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Security Reports for dependency scanning displays the Dependency List File: security_reports_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF File: vulnerability_security_training_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON File: vulnerability_security_training_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget File: vulnerability_management_spec.rb |
20 | 0 | 0% |
Name: Govern Vulnerability report in a project can export vulnerability report to csv File: export_vulnerability_report_spec.rb |
13 | 0 | 0% |
Manage (2)
Executions table groupimport and integrate (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Manage Gitlab migration with import within same instance successfully imports project File: gitlab_migration_project_spec.rb |
13 | 0 | 0% |
Name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab File: jenkins_build_status_spec.rb |
13 | 0 | 0% |
Monitor (4)
Executions table grouprespond (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb |
20 | 0 | 0% |
Name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident File: automatically_creates_incident_for_alert_spec.rb |
20 | 0 | 0% |
Name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert File: recovery_alert_resolves_correct_alert_spec.rb |
20 | 0 | 0% |
Name: Monitor Create incident adds linked resources, label, and severity through quick actions File: incident_quick_action_spec.rb |
13 | 0 | 0% |
Package (34)
Executions table grouppackage registry (34)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Package Conan Repository publishes, installs, and deletes a Conan package File: conan_repository_spec.rb |
20 | 0 | 0% |
Name: Package Generic Repository uploads a generic package and downloads it File: generic_repository_spec.rb |
20 | 0 | 0% |
Name: Package Helm Registry using ci job token pushes and pulls a helm chart File: helm_registry_spec.rb |
20 | 0 | 0% |
Name: Package Helm Registry using personal access token pushes and pulls a helm chart File: helm_registry_spec.rb |
20 | 0 | 0% |
Name: Package Helm Registry using project deploy token pushes and pulls a helm chart File: helm_registry_spec.rb |
20 | 0 | 0% |
Name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle File: maven_gradle_repository_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package File: maven_group_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven File: maven_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint File: nuget_group_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a ci job token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a personal access token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package NuGet project level endpoint using a project deploy token publishes a nuget package and installs File: nuget_project_level_spec.rb |
20 | 0 | 0% |
Name: Package PyPI Repository when at the project level publishes and installs a pypi package File: pypi_repository_spec.rb |
20 | 0 | 0% |
Name: Package RubyGems Repository publishes a Ruby gem File: rubygems_registry_spec.rb |
20 | 0 | 0% |
Name: Package Terraform Module Registry publishes a module File: terraform_module_registry_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI File: npm_group_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI File: npm_instance_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI File: npm_project_level_spec.rb |
20 | 0 | 0% |
Plan (23)
Executions table groupknowledge (13)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan A project wiki can change the directory path of a page File: project_based_directory_management_spec.rb |
20 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki has a home page adds a second page File: create_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Creating pages in group wikis when wiki is empty creates a new page File: create_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Project Wiki with Wiki Page List has all expected links that work File: project_based_list_spec.rb |
20 | 0 | 0% |
Name: Plan Project Wiki with Wiki Sidebar has all expected links that work File: project_based_list_spec.rb |
20 | 0 | 0% |
Name: Plan Testing group wiki can delete a group wiki page File: delete_group_wiki_page_spec.rb |
20 | 0 | 0% |
Name: Plan Testing project wiki can delete a page File: project_based_page_deletion_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push File: project_based_content_creation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page File: project_based_content_manipulation_spec.rb |
20 | 0 | 0% |
Name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push File: project_based_content_manipulation_spec.rb |
20 | 0 | 0% |
Executions table groupproject management (6)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Assign Iterations assigns a group iteration to an existing issue File: assign_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Assignees update without refresh File: real_time_assignee_spec.rb |
20 | 0 | 0% |
Name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels File: editing_scoped_labels_spec.rb |
20 | 0 | 0% |
Name: Plan Group Iterations with automatic scheduling creates a group iteration automatically through an iteration cadence File: create_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Group Iterations with manual scheduling creates a group iteration manually through an iteration cadence File: create_group_iteration_spec.rb |
20 | 0 | 0% |
Name: Plan Issue closes via pushing a commit File: closes_issue_via_pushing_a_commit_spec.rb |
20 | 0 | 0% |
Executions table groupproduct planning (4)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Design Management user adds a design and annotates it File: add_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Design Management user adds a design and modifies it File: modify_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Design Management user archives a design File: archive_design_content_spec.rb |
20 | 0 | 0% |
Name: Plan Epics milestone dates API updates epic dates when updating milestones File: epics_milestone_dates_spec.rb |
20 | 0 | 0% |
Release (5)
Executions table groupenvironments (5)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Release Deploy key creation user adds a deploy key File: add_deploy_key_spec.rb |
20 | 0 | 0% |
Name: Release Deploy token creation user adds a deploy token File: add_deploy_token_spec.rb |
20 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
20 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
20 | 0 | 0% |
Name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines File: clone_using_deploy_key_spec.rb |
20 | 0 | 0% |
Secure (2)
Executions table groupstatic analysis (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
20 | 0 | 0% |
Name: Secure Enable Scanning from UI enable sast from configuration runs sast job when enabled from configuration File: enable_scanning_from_configuration_spec.rb |
20 | 0 | 0% |
Verify (14)
Executions table grouppipeline security (8)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Job artifacts when exposed show up in MR widget File: expose_job_artifacts_in_mr_spec.rb |
20 | 0 | 0% |
Name: Verify Project artifacts when user tries bulk deletion successfully delete them File: user_can_bulk_delete_artifacts_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is inheritable when forward:pipeline_variables is true File: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is not inheritable by default File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
20 | 0 | 0% |
Name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false File: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline failed keeps job artifacts from latest failed pipelines and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is blocked keeps job artifacts from the latest blocked pipeline and from latest successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
20 | 0 | 0% |
Name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline File: unlocking_job_artifacts_across_pipelines_spec.rb |
20 | 0 | 0% |
Executions table grouprunner (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Runner fleet management shows group runner online count File: group_runner_status_counts_spec.rb |
20 | 0 | 0% |
Name: Verify Runner registration user registers a new project runner File: register_runner_spec.rb |
20 | 0 | 0% |
Executions table grouppipeline execution (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job File: trigger_child_pipeline_with_manual_spec.rb |
20 | 0 | 0% |
Name: Verify When user is blocked pipeline schedule is canceled File: cancel_pipeline_when_block_user_spec.rb |
20 | 0 | 0% |
Executions table grouppipeline authoring (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables File: trigger_matrix_spec.rb |
20 | 0 | 0% |
Name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request File: update_ci_file_with_pipeline_editor_spec.rb |
20 | 0 | 0% |
Reliable specs with failures (2023-11-06 - 2023-11-20)
Total amount: 69
STAGE | COUNT |
---|---|
create | 22 |
data_stores | 8 |
govern | 5 |
plan | 4 |
verify | 30 |
Create (22)
Executions table groupcode review (15)
Executions table groupsource code (7)
Data_stores (8)
Executions table grouptenant scale (8)
Govern (5)
Executions table groupcompliance (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Project for add user access as guest behaves like audit event logs audit events for UI operations File: project_audit_logs_spec.rb Exceptions: - Unable to find css "[data-testid=\"invite_members_button\"],[data-qa-selector=\"invite_members_button\"]"
|
350 | 1 | 0.29% |
Executions table groupthreat insights (3)
Executions table groupsecurity policies (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy File: scan_result_policy_vulnerabilities_spec.rb Exceptions: - Fabrication of QA::EE::Resource::ScanResultPolicyCommit using the API failed (200) with '{"data":{"scanExecutionPolicyCommit":{"branch":null,"errors":["Invalid policy","Required approvals exceed eligible approvers."]}}}'.Correlation Id: 29c07e4f10... - Timed out waiting for MR with id '1' to be prepared. - Timed out waiting for merge of MR with id '1'. Final status was 'checking' - Fabrication of QA::EE::Resource::ScanResultPolicyCommit using the API failed (200) with '{"data":{"scanExecutionPolicyCommit":{"branch":null,"errors":["Invalid policy","Required approvals exceed eligible approvers."]}}}'.Correlation Id: 9f5fa41e89...
|
348 | 7 | 2.01% |
Plan (4)
Executions table groupoptimize (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Merge Request Analytics shows merge request analytics chart and stats File: mr_analytics_spec.rb Exceptions: - Timed out waiting for MR with id '1' to be prepared. - Timed out waiting for merge of MR with id '2'. Final status was 'checking'
|
210 | 6 | 2.86% |
Name: Plan Contribution Analytics tests contributions File: contribution_analytics_spec.rb Exceptions: - Fabrication of QA::Resource::Project using the API failed (502) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1, maximum-scale=1" name="viewport"> <title>500 Error - GitLab</title> <style>body{align-items:ce... - Timed out waiting for MR with id '1' to be prepared.
|
349 | 3 | 0.86% |
Executions table groupproduct planning (2)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions File: epics_management_spec.rb Exceptions: - expected QA::EE::Page::Group::Epic::Show to have system note "added issue"
|
351 | 4 | 1.14% |
Name: Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic File: epics_management_spec.rb Exceptions: - expected QA::EE::Page::Group::Epic::Show to have related issue item
|
351 | 1 | 0.28% |
Verify (30)
Executions table grouppipeline security (12)
Executions table grouprunner (1)
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
Name: Verify Group runner registration user registers a new group runner File: register_group_runner_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
350 | 1 | 0.29% |