Reliable e2e test report
- Candidates for promotion to reliable (2023-04-25 - 2023-05-09)
- Reliable specs with failures (2023-04-25 - 2023-05-09)
Candidates for promotion to reliable (2023-04-25 - 2023-05-09)
Total amount: 145
STAGE | COUNT |
---|---|
analytics | 1 |
configure | 3 |
create | 65 |
unknown | 4 |
data_stores | 12 |
fulfillment | 2 |
govern | 8 |
growth | 2 |
manage | 11 |
monitor | 3 |
package | 2 |
plan | 9 |
release | 5 |
systems | 2 |
verify | 16 |
analytics (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled file: service_ping_default_enabled_spec.rb |
96 | 0 | 0% |
configure (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Configure Kubernetes Agent deploys a K8s manifest file file: kubernetes_agent_spec.rb |
133 | 0 | 0% |
name: Configure Auto DevOps with a Kubernetes Agent runs auto devops file: create_project_with_auto_devops_spec.rb |
132 | 0 | 0% |
name: Configure AutoDevOps Templates using express template works with Auto DevOps file: auto_devops_templates_spec.rb |
69 | 0 | 0% |
create (65)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create API basics raw file access sets no-cache headers as expected file: files_spec.rb |
160 | 0 | 0% |
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet file: add_comment_to_snippet_spec.rb |
160 | 0 | 0% |
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet file: add_comment_to_snippet_spec.rb |
160 | 0 | 0% |
name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly file: branch_with_unusual_name_spec.rb |
160 | 0 | 0% |
name: Create Commit data user views raw commit diff file: user_views_commit_diff_patch_spec.rb |
160 | 0 | 0% |
name: Create Create a new project from a template commits via the api file: commit_to_templated_project_spec.rb |
160 | 0 | 0% |
name: Create File management user deletes a file via the Web file: delete_file_via_web_spec.rb |
160 | 0 | 0% |
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly file: file_with_unusual_name_spec.rb |
160 | 0 | 0% |
name: Create Git clone over HTTP user performs a deep clone file: clone_spec.rb |
160 | 0 | 0% |
name: Create Git clone over HTTP user performs a shallow clone file: clone_spec.rb |
160 | 0 | 0% |
name: Create Merge request push options removes the source branch file: push_options_remove_source_branch_spec.rb |
160 | 0 | 0% |
name: Create Merge request push options sets a target branch file: push_options_target_branch_spec.rb |
160 | 0 | 0% |
name: Create Merge request push options sets labels file: push_options_labels_spec.rb |
160 | 0 | 0% |
name: Create Merge request push options sets merge when pipeline succeeds file: push_options_mwps_spec.rb |
160 | 0 | 0% |
name: Create Merge request push options when labels are set already removes them on subsequent push file: push_options_labels_spec.rb |
160 | 0 | 0% |
name: Create Merge request rebasing user rebases source branch of merge request file: rebase_merge_request_spec.rb |
160 | 0 | 0% |
name: Create Merge request squashing user squashes commits while merging file: squash_merge_request_spec.rb |
160 | 0 | 0% |
name: Create PostReceive idempotent pushes and creates a single push event three times file: push_postreceive_idempotent_spec.rb |
160 | 0 | 0% |
name: Create Push over HTTP using Git protocol version 2 user pushes to the repository file: protocol_v2_push_http_spec.rb |
160 | 0 | 0% |
name: Create Push over SSH using Git protocol version 2 user pushes to the repository file: protocol_v2_push_ssh_spec.rb |
160 | 0 | 0% |
name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb |
160 | 0 | 0% |
name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb |
160 | 0 | 0% |
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI file: clone_push_pull_personal_snippet_spec.rb |
160 | 0 | 0% |
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI file: clone_push_pull_personal_snippet_spec.rb |
160 | 0 | 0% |
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI file: clone_push_pull_project_snippet_spec.rb |
160 | 0 | 0% |
name: Create File templates user adds .gitignore via file template Android file: add_file_template_spec.rb |
159 | 0 | 0% |
name: Create File templates user adds .gitlab-ci.yml via file template Julia file: add_file_template_spec.rb |
159 | 0 | 0% |
name: Create File templates user adds Dockerfile via file template Python file: add_file_template_spec.rb |
159 | 0 | 0% |
name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 file: add_file_template_spec.rb |
159 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
159 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
159 | 0 | 0% |
name: Create Project snippet creation user creates a project snippet file: create_project_snippet_spec.rb |
159 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
159 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
159 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
159 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
159 | 0 | 0% |
name: Create Codeowners displays owners specified in CODEOWNERS file file: code_owners_spec.rb |
147 | 0 | 0% |
name: Create File Locking checks file locked by other user to be disabled file: file_locking_spec.rb |
147 | 0 | 0% |
name: Create File Locking creates a merge request and fails to merge file: file_locking_spec.rb |
147 | 0 | 0% |
name: Create File Locking locks a directory and tries to push as a second user file: file_locking_spec.rb |
147 | 0 | 0% |
name: Create File Locking locks a file and tries to push as a second user file: file_locking_spec.rb |
147 | 0 | 0% |
name: Create File Locking locks a file and unlocks in list file: file_locking_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits allows an unrestricted push file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts branches by branch name file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts commit by message format file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts committing files with secrets file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts files by name and size file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts removal of tag file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using non signed commits restricts users by email format file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules using signed commits restricts to signed commits file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Push Rules with commits restricted to verified emails rejects unverified emails file: push_rules_spec.rb |
147 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb |
147 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb |
147 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb |
147 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb |
147 | 0 | 0% |
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled file: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
147 | 0 | 0% |
name: Create batch comments in merge request user submits a diff review file: add_batch_comments_in_merge_request_spec.rb |
147 | 0 | 0% |
name: Create batch comments in merge request user submits a non-diff review file: add_batch_comments_in_merge_request_spec.rb |
147 | 0 | 0% |
name: Create Create, list, and delete branches via web lists branches correctly after CRUD operations file: add_list_delete_branches_spec.rb |
96 | 0 | 0% |
name: Create Group file templates creates file via custom .gitignore file template file: group_file_template_spec.rb |
84 | 0 | 0% |
name: Create Group file templates creates file via custom .gitlab-ci.yml file template file: group_file_template_spec.rb |
84 | 0 | 0% |
name: Create Group file templates creates file via custom Dockerfile file template file: group_file_template_spec.rb |
84 | 0 | 0% |
name: Create Group file templates creates file via custom LICENSE file template file: group_file_template_spec.rb |
84 | 0 | 0% |
name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository file: pull_mirroring_over_ssh_with_key_spec.rb |
78 | 0 | 0% |
unknown (4)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
84 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
84 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
84 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb |
84 | 0 | 0% |
data_stores (12)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API file: user_inherited_access_spec.rb |
96 | 0 | 0% |
name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API file: user_inherited_access_spec.rb |
96 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user file: elasticsearch_api_spec.rb |
93 | 0 | 0% |
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description file: advanced_global_advanced_syntax_search_spec.rb |
81 | 0 | 0% |
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name file: advanced_global_advanced_syntax_search_spec.rb |
81 | 0 | 0% |
name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message file: commit_index_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user file: elasticsearch_api_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user file: elasticsearch_api_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content file: blob_index_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description file: issue_index_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description file: merge_request_index_spec.rb |
81 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body file: note_index_spec.rb |
81 | 0 | 0% |
fulfillment (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Fulfillment Utilization in usage quotas storage tab for free plan with a project shows correct used up storage for namespace file: free_namespace_storage_spec.rb |
55 | 0 | 0% |
name: Fulfillment Utilization when Saas user limit experience enforcement does not allow adding more members file: saas_user_limit_experience_spec.rb |
55 | 0 | 0% |
govern (8)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Govern Group for add group behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
147 | 0 | 0% |
name: Govern Group for change project creation level behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
147 | 0 | 0% |
name: Govern Security Reports dependency list has empty state file: security_reports_spec.rb |
147 | 0 | 0% |
name: Govern Security Reports displays security reports in the group security dashboard file: security_reports_spec.rb |
147 | 0 | 0% |
name: Govern Security Reports displays security reports in the pipeline file: security_reports_spec.rb |
147 | 0 | 0% |
name: Govern Security Reports displays security reports in the project security dashboard file: security_reports_spec.rb |
147 | 0 | 0% |
name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab file: vulnerability_management_spec.rb |
147 | 0 | 0% |
name: Govern project vulnerability report can successfully bulk change status in vulnerability report file: change_vulnerability_status_spec.rb |
147 | 0 | 0% |
growth (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Growth SaaS trials starts a free trial when on about page with multiple eligible namespaces registers for a new trial file: free_trial_spec.rb |
69 | 0 | 0% |
name: Growth SaaS trials starts a free trial when on billing page with only one eligible namespace registers for a new trial file: free_trial_spec.rb |
69 | 0 | 0% |
manage (11)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage Group access token can be used to commit via the API file: group_access_token_spec.rb |
160 | 0 | 0% |
name: Manage Group access token can be used to create a file via the project API file: group_access_token_spec.rb |
160 | 0 | 0% |
name: Manage Group access tokens can be created and revoked via the UI file: group_access_token_spec.rb |
160 | 0 | 0% |
name: Manage Impersonation tokens can be created and revoked via the UI file: impersonation_token_spec.rb |
96 | 0 | 0% |
name: Manage User after parent group membership termination is not allowed to commit via the API file: user_access_termination_spec.rb |
96 | 0 | 0% |
name: Manage User after parent group membership termination is not allowed to create a file via the API file: user_access_termination_spec.rb |
96 | 0 | 0% |
name: Manage User after parent group membership termination is not allowed to push code via the CLI file: user_access_termination_spec.rb |
96 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to commit via the API file: minimal_access_user_spec.rb |
84 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to create a file via the API file: minimal_access_user_spec.rb |
84 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to edit files via the UI file: minimal_access_user_spec.rb |
84 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to push code via the CLI file: minimal_access_user_spec.rb |
84 | 0 | 0% |
monitor (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident file: automatically_creates_incident_for_alert_spec.rb |
159 | 0 | 0% |
name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert file: recovery_alert_resolves_correct_alert_spec.rb |
159 | 0 | 0% |
name: Monitor Recovery alert when using HTTP endpoint integration behaves like triggers recovery alert only resolves the correct alert file: recovery_alert_resolves_correct_alert_spec.rb |
132 | 0 | 0% |
package (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Package Composer Repository publishes a composer package and deletes it file: composer_registry_spec.rb |
132 | 0 | 0% |
name: Package RubyGems Repository publishes a Ruby gem file: rubygems_registry_spec.rb |
69 | 0 | 0% |
plan (9)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan Assignees update without refresh file: real_time_assignee_spec.rb |
160 | 0 | 0% |
name: Plan Design Management user adds a design and annotates it file: add_design_content_spec.rb |
160 | 0 | 0% |
name: Plan Design Management user adds a design and modifies it file: modify_design_content_spec.rb |
160 | 0 | 0% |
name: Plan Issue closes via pushing a commit file: closes_issue_via_pushing_a_commit_spec.rb |
160 | 0 | 0% |
name: Plan Assign Iterations assigns a group iteration to an existing issue file: assign_group_iteration_spec.rb |
148 | 0 | 0% |
name: Plan Contribution Analytics tests contributions file: contribution_analytics_spec.rb |
148 | 0 | 0% |
name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels file: editing_scoped_labels_spec.rb |
148 | 0 | 0% |
name: Plan Epics milestone dates API updates epic dates when updating milestones file: epics_milestone_dates_spec.rb |
148 | 0 | 0% |
name: Plan Group Iterations creates a group iteration automatically through an iteration cadence file: create_group_iteration_spec.rb |
148 | 0 | 0% |
release (5)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Release Deploy token creation user adds a deploy token file: add_deploy_token_spec.rb |
160 | 0 | 0% |
name: Release Deploy key creation user adds a deploy key file: add_deploy_key_spec.rb |
159 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
159 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
159 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
159 | 0 | 0% |
systems (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Systems Changing Gitaly repository storage when moving from Gitaly Cluster to Gitaly behaves like repository storage move confirms a finished status after moving project repository storagefile: changing_repository_storage_spec.rb |
69 | 0 | 0% |
name: Systems Changing Gitaly repository storage when moving from Gitaly to Gitaly Cluster behaves like repository storage move confirms a finished status after moving project repository storagefile: changing_repository_storage_spec.rb |
69 | 0 | 0% |
verify (16)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition file: api_variable_inheritance_with_forward_pipeline_variables_spec.rb |
160 | 0 | 0% |
name: Verify Pipeline with project file variables can read file variable content with cat file: file_variable_spec.rb |
160 | 0 | 0% |
name: Verify Pipeline with project file variables does not expose file variable content with echo file: file_variable_spec.rb |
160 | 0 | 0% |
name: Verify Code coverage statistics creates an MR with code coverage statistics file: view_code_coverage_spec.rb |
159 | 0 | 0% |
name: Verify Endpoint Coverage spans r/w postgres web sidekiq git api file: endpoint_coverage_spec.rb |
159 | 0 | 0% |
name: Verify Include multiple files from a project runs the pipeline with composed config file: include_multiple_files_from_a_project_spec.rb |
159 | 0 | 0% |
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb |
159 | 0 | 0% |
name: Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value file: custom_variable_spec.rb |
159 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb |
159 | 0 | 0% |
name: Verify Run pipeline with manual jobs does not leave any job in skipped state file: run_pipeline_with_manual_jobs_spec.rb |
159 | 0 | 0% |
name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables file: trigger_matrix_spec.rb |
159 | 0 | 0% |
name: Verify Update CI file with pipeline editor creates new pipeline and target branch file: update_ci_file_with_pipeline_editor_spec.rb |
159 | 0 | 0% |
name: Verify Multi-project pipelines creates a multi-project pipeline with artifact download file: multi-project_pipelines_spec.rb |
147 | 0 | 0% |
name: Verify In merge trains new thread discussion does not drop MR file: new_discussion_not_dropping_merge_trains_mr_spec.rb |
112 | 0 | 0% |
name: Verify When user is blocked pipeline schedule is canceled file: cancel_pipeline_when_block_user_spec.rb |
96 | 0 | 0% |
name: Verify Cancelling merge request in merge train when user cancels the merge request does not create a TODO task file: user_cancel_merge_request_in_merge_train_spec.rb |
84 | 0 | 0% |
Reliable specs with failures (2023-04-25 - 2023-05-09)
Total amount: 55
STAGE | COUNT |
---|---|
create | 14 |
data_stores | 3 |
govern | 14 |
manage | 1 |
package | 1 |
plan | 13 |
verify | 9 |
create (14)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user file: protected_tags_spec.rb |
496 | 3 | 0.6% |
name: Create Reverting a commit creates a merge request file: revert_commit_spec.rb |
496 | 3 | 0.6% |
name: Create Merge request custom templates creates a merge request via custom template file: create_merge_request_via_template_spec.rb |
496 | 2 | 0.4% |
name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push to the protected branch file: push_protected_branch_spec.rb |
495 | 2 | 0.4% |
name: Create Repository tags when not protected behaves like successful tag creation can be created by developer_user file: protected_tags_spec.rb |
496 | 2 | 0.4% |
name: Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user file: protected_tags_spec.rb |
496 | 2 | 0.4% |
name: Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user file: protected_tags_spec.rb |
496 | 2 | 0.4% |
name: Create with merge request batch suggestions applies multiple suggestions file: batch_suggestion_spec.rb |
496 | 2 | 0.4% |
name: Create File management user edits a file via the Web file: edit_file_via_web_spec.rb |
495 | 1 | 0.2% |
name: Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file personal_snippet to a comment and verifies them file: copy_snippet_file_contents_spec.rb |
496 | 1 | 0.2% |
name: Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them file: copy_snippet_file_contents_spec.rb |
496 | 1 | 0.2% |
name: Create Multiple file snippet creates a personal snippet with multiple files file: create_personal_snippet_with_multiple_files_spec.rb |
495 | 1 | 0.2% |
name: Create Multiple file snippet creates a project snippet with multiple files file: create_project_snippet_with_multiple_files_spec.rb |
495 | 1 | 0.2% |
name: Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown file: share_snippet_spec.rb |
495 | 1 | 0.2% |
data_stores (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Data Stores User when parent group membership is terminated is not allowed to edit the project files file: parent_group_access_termination_spec.rb |
206 | 1 | 0.49% |
name: Data Stores Add project member user adds project member file: add_project_member_spec.rb |
363 | 1 | 0.28% |
name: Data Stores Invite group with a personal namespace project behaves like invites group to project verifies group is added and members can access project with correct access level file: invite_group_to_project_spec.rb |
363 | 1 | 0.28% |
govern (14)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Govern Project for add project behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
483 | 12 | 2.48% |
name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget file: vulnerability_management_spec.rb |
483 | 7 | 1.45% |
name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget file: vulnerability_management_spec.rb |
483 | 6 | 1.24% |
name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget file: vulnerability_management_spec.rb |
483 | 4 | 0.83% |
name: Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy file: scan_result_policy_vulnerabilities_spec.rb |
483 | 3 | 0.62% |
name: Govern Security Dashboard in a Project shows vulnerability details file: project_security_dashboard_spec.rb |
482 | 2 | 0.41% |
name: Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab file: vulnerability_management_spec.rb |
483 | 2 | 0.41% |
name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
263 | 1 | 0.38% |
name: Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
483 | 1 | 0.21% |
name: Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb |
481 | 1 | 0.21% |
name: Govern Group for update group name behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
483 | 1 | 0.21% |
name: Govern Project for add user access as guest behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb |
483 | 1 | 0.21% |
name: Govern Security Dashboard in a Project creates an issue from vulnerability details file: project_security_dashboard_spec.rb |
482 | 1 | 0.21% |
name: Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget file: create_merge_request_with_secure_spec.rb |
483 | 1 | 0.21% |
manage (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage Project access tokens can be created and revoked via the UI file: project_access_token_spec.rb |
496 | 1 | 0.2% |
package (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Package Container Registry pushes, pulls image to the registry and deletes tag file: container_registry_spec.rb |
332 | 3 | 0.9% |
plan (13)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan Custom email customizes email with additional text file: custom_email_spec.rb |
262 | 8 | 3.05% |
name: Plan Epics milestone dates API updates epic dates when removing issue file: epics_milestone_dates_spec.rb |
484 | 2 | 0.41% |
name: Plan Default issue templates uses default template when creating an issue file: default_issue_template_spec.rb |
483 | 1 | 0.21% |
name: Plan Epics milestone dates API updates epic dates when adding another issue file: epics_milestone_dates_spec.rb |
484 | 1 | 0.21% |
name: Plan Epics milestone dates API updates epic dates when deleting milestones file: epics_milestone_dates_spec.rb |
484 | 1 | 0.21% |
name: Plan Group issue boards creates a group issue board via the GUI file: create_group_issue_board_spec.rb |
483 | 1 | 0.21% |
name: Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page file: more_than_four_assignees_spec.rb |
484 | 1 | 0.21% |
name: Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list file: more_than_four_assignees_spec.rb |
484 | 1 | 0.21% |
name: Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it file: project_issue_boards_spec.rb |
484 | 1 | 0.21% |
name: Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it file: project_issue_boards_spec.rb |
484 | 1 | 0.21% |
name: Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it file: project_issue_boards_spec.rb |
484 | 1 | 0.21% |
name: Plan Custom issue templates creates an issue via custom template file: custom_issue_template_spec.rb |
495 | 1 | 0.2% |
name: Plan Related issues relates and unrelates one issue to/from another file: related_issues_spec.rb |
495 | 1 | 0.2% |
verify (9)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails file: parent_child_pipelines_independent_relationship_spec.rb |
495 | 4 | 0.81% |
name: Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails file: parent_child_pipelines_dependent_relationship_spec.rb |
482 | 3 | 0.62% |
name: Verify Run pipeline with web only rule can trigger pipeline file: run_pipeline_via_web_only_spec.rb |
494 | 3 | 0.61% |
name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes file: parent_child_pipelines_dependent_relationship_spec.rb |
482 | 2 | 0.41% |
name: Verify Parent-child pipelines independent relationship parent pipelines passes if child passes file: parent_child_pipelines_independent_relationship_spec.rb |
495 | 2 | 0.4% |
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results file: pipelines_for_merged_results_and_merge_trains_spec.rb |
483 | 1 | 0.21% |
name: Verify Pipelines for merged results and merge trains merges via a merge train file: pipelines_for_merged_results_and_merge_trains_spec.rb |
483 | 1 | 0.21% |
name: Verify Include local config file paths with wildcard runs the pipeline with composed config file: include_local_config_file_paths_with_wildcard_spec.rb |
494 | 1 | 0.2% |
name: Verify Pipeline editor when CI has valid syntax shows valid validations file: pipeline_editor_tabs_spec.rb |
494 | 1 | 0.2% |