Skip to content

Reliable e2e test report

Candidates for promotion to reliable (2023-10-02 - 2023-10-16)

Total amount: 249

STAGE COUNT
analytics 2
create 81
data_stores 23
fulfillment 2
govern 24
manage 18
monitor 3
package 28
plan 21
release 5
secure 1
verify 41

analytics (2)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled
file: service_ping_default_enabled_spec.rb
19 0 0%
name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests
file: performance_bar_spec.rb
13 0 0%

create (81)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Create API basics raw file access sets no-cache headers as expected
file: files_spec.rb
19 0 0%
name: Create API basics user creates a project with a file and deletes them afterwards
file: files_spec.rb
19 0 0%
name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error
file: add_new_directory_in_web_ide_spec.rb
19 0 0%
name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed
file: add_new_directory_in_web_ide_spec.rb
19 0 0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet
file: add_comment_to_snippet_spec.rb
19 0 0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet
file: add_comment_to_snippet_spec.rb
19 0 0%
name: Create Branch Rules Overview adds a new branch rule
file: add_new_branch_rule_spec.rb
19 0 0%
name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly
file: branch_with_unusual_name_spec.rb
19 0 0%
name: Create Codeowners displays owners specified in CODEOWNERS file
file: code_owners_spec.rb
19 0 0%
name: Create Codeowners merge request assigns code owners as approvers
file: assign_code_owners_spec.rb
19 0 0%
name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged
file: merge_with_code_owner_in_subgroup_spec.rb
19 0 0%
name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged
file: merge_with_code_owner_in_subgroup_spec.rb
19 0 0%
name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged
file: merge_with_code_owner_in_root_group_spec.rb
19 0 0%
name: Create Create a new merge request creates a merge request with a milestone and label
file: create_merge_request_spec.rb
19 0 0%
name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches
file: add_list_delete_branches_spec.rb
19 0 0%
name: Create File Locking checks file locked by other user to be disabled
file: file_locking_spec.rb
19 0 0%
name: Create File Locking creates a merge request and fails to merge
file: file_locking_spec.rb
19 0 0%
name: Create File Locking locks a directory and tries to push as a second user
file: file_locking_spec.rb
19 0 0%
name: Create File Locking locks a file and tries to push as a second user
file: file_locking_spec.rb
19 0 0%
name: Create File Locking locks a file and unlocks in list
file: file_locking_spec.rb
19 0 0%
name: Create File management user deletes a file via the Web
file: delete_file_via_web_spec.rb
19 0 0%
name: Create File templates user adds .gitignore via file template Android
file: add_file_template_spec.rb
19 0 0%
name: Create File templates user adds .gitlab-ci.yml via file template Julia
file: add_file_template_spec.rb
19 0 0%
name: Create File templates user adds Dockerfile via file template Python
file: add_file_template_spec.rb
19 0 0%
name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0
file: add_file_template_spec.rb
19 0 0%
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly
file: file_with_unusual_name_spec.rb
19 0 0%
name: Create Git clone over HTTP user performs a deep clone
file: clone_spec.rb
19 0 0%
name: Create Git clone over HTTP user performs a shallow clone
file: clone_spec.rb
19 0 0%
name: Create Group file templates creates file via custom .gitignore file template
file: group_file_template_spec.rb
19 0 0%
name: Create Group file templates creates file via custom .gitlab-ci.yml file template
file: group_file_template_spec.rb
19 0 0%
name: Create Group file templates creates file via custom Dockerfile file template
file: group_file_template_spec.rb
19 0 0%
name: Create Group file templates creates file via custom LICENSE file template
file: group_file_template_spec.rb
19 0 0%
name: Create Merge request creation from fork can merge source branch from fork into upstream repository
file: merge_merge_request_from_fork_spec.rb
19 0 0%
name: Create Merge request push options sets merge when pipeline succeeds
file: push_options_mwps_spec.rb
19 0 0%
name: Create Merge request rebasing user rebases source branch of merge request
file: rebase_merge_request_spec.rb
Exceptions:
- Page did not fully load. This could be due to an unending async request or loading icon.:expected to eventually be_truthy: []last attempt was: nilDiff:
19 0 0%
name: Create Merged merge request can be reverted
file: reverting_merge_request_spec.rb
19 0 0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file
file: add_file_to_snippet_spec.rb
19 0 0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file
file: add_file_to_snippet_spec.rb
19 0 0%
name: Create PostReceive idempotent pushes and creates a single push event three times
file: push_postreceive_idempotent_spec.rb
19 0 0%
name: Create Project snippet creation user creates a project snippet
file: create_project_snippet_spec.rb
19 0 0%
name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth
file: pull_mirroring_over_http_spec.rb
19 0 0%
name: Create Push Rules using non signed commits allows an unrestricted push
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts branches by branch name
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts commit by message format
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts committing files with secrets
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts files by name and size
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts removal of tag
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using non signed commits restricts users by email format
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules using signed commits restricts to signed commits
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users
file: push_rules_spec.rb
19 0 0%
name: Create Push Rules with commits restricted to verified emails rejects unverified emails
file: push_rules_spec.rb
19 0 0%
name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository
file: push_mirroring_lfs_over_http_spec.rb
19 0 0%
name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository
file: push_mirroring_over_http_spec.rb
19 0 0%
name: Create Push over HTTP using Git protocol version 2 user pushes to the repository
file: protocol_v2_push_http_spec.rb
19 0 0%
name: Create Push over SSH using Git protocol version 2 user pushes to the repository
file: protocol_v2_push_ssh_spec.rb
19 0 0%
name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository
file: license_detection_spec.rb
19 0 0%
name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository
file: license_detection_spec.rb
19 0 0%
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges
file: restrict_push_protected_branch_spec.rb
19 0 0%
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push
file: restrict_push_protected_branch_spec.rb
19 0 0%
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges
file: restrict_push_protected_branch_spec.rb
19 0 0%
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push
file: restrict_push_protected_branch_spec.rb
19 0 0%
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled
file: code_owners_with_protected_branch_and_squashed_commits_spec.rb
19 0 0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number
file: snippet_index_page_spec.rb
19 0 0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number
file: snippet_index_page_spec.rb
19 0 0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number
file: snippet_index_page_spec.rb
19 0 0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number
file: snippet_index_page_spec.rb
19 0 0%
name: Create Source editor toolbar preview can preview markdown side-by-side while editing
file: source_editor_toolbar_spec.rb
19 0 0%
name: Create Upload a file in Web IDE when a file with the same name already exists throws an error
file: upload_new_file_in_web_ide_spec.rb
19 0 0%
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI
file: clone_push_pull_personal_snippet_spec.rb
19 0 0%
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI
file: clone_push_pull_personal_snippet_spec.rb
19 0 0%
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI
file: clone_push_pull_project_snippet_spec.rb
19 0 0%
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI
file: clone_push_pull_project_snippet_spec.rb
19 0 0%
name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged
file: merge_with_code_owner_in_subgroup_spec.rb
13 0 0%
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged
file: merge_with_code_owner_in_root_group_spec.rb
13 0 0%
name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name
file: default_branch_name_setting_spec.rb
13 0 0%
name: Create Default branch name instance setting sets the default branch name for a new project
file: default_branch_name_setting_spec.rb
13 0 0%
name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error
file: tag_revision_trigger_prereceive_hook_spec.rb
13 0 0%
name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository
file: pull_mirroring_over_ssh_with_key_spec.rb
13 0 0%
name: Create Repository Usage Quota matches cloned repo usage to reported usage
file: storage_size_spec.rb
13 0 0%
name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit
file: push_over_http_file_size_spec.rb
13 0 0%
name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit
file: push_over_http_file_size_spec.rb
13 0 0%

data_stores (23)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user
file: nightly_elasticsearch_test_spec.rb
110 0 0%
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description
file: advanced_global_advanced_syntax_search_spec.rb
58 0 0%
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name
file: advanced_global_advanced_syntax_search_spec.rb
58 0 0%
name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message
file: commit_index_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user
file: elasticsearch_api_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user
file: elasticsearch_api_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content
file: blob_index_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description
file: issue_index_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description
file: merge_request_index_spec.rb
58 0 0%
name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body
file: note_index_spec.rb
58 0 0%
name: Data Stores When using advanced search API to search for a user finds the user that matches username
file: user_index_spec.rb
52 0 0%
name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API
file: user_inherited_access_spec.rb
19 0 0%
name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API
file: user_inherited_access_spec.rb
19 0 0%
name: Data Stores Group member access request generates a todo item for the group owner
file: group_member_access_request_spec.rb
13 0 0%
name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group
file: group_member_access_request_spec.rb
13 0 0%
name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group
file: group_member_access_request_spec.rb
13 0 0%
name: Data Stores Group with members can be shared with another group with correct access level
file: share_group_with_group_spec.rb
13 0 0%
name: Data Stores Subgroup transfer transfers a subgroup to another group
file: transfer_group_spec.rb
13 0 0%
name: Data Stores User can be followed and their activity seen
file: follow_user_activity_spec.rb
13 0 0%
name: Data Stores User when added to parent group is allowed to edit the sub-group project files
file: user_inherited_access_spec.rb
13 0 0%
name: Data Stores User when added to sub-group is not allowed to edit the parent group project files
file: user_inherited_access_spec.rb
13 0 0%
name: Data Stores prevent forking outside group when disabled allows forking outside of group
file: prevent_forking_outside_group_spec.rb
13 0 0%
name: Data Stores prevent forking outside group when enabled does not allow forking outside of group
file: prevent_forking_outside_group_spec.rb
13 0 0%

fulfillment (2)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Fulfillment Active license details shows up in subscription page
file: license_spec.rb
13 0 0%
name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license
file: user_registration_billing_spec.rb
13 0 0%

govern (24)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned
file: compliance_pipeline_spec.rb
19 0 0%
name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations
file: group_audit_logs_1_spec.rb
19 0 0%
name: Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings
file: scan_result_policy_vulnerabilities_spec.rb
19 0 0%
name: Govern Security Reports dependency list has empty state
file: security_reports_spec.rb
19 0 0%
name: Govern Security Reports displays false positives for the vulnerabilities
file: security_reports_spec.rb
19 0 0%
name: Govern Security Reports displays security reports in the group security dashboard
file: security_reports_spec.rb
19 0 0%
name: Govern Security Reports displays security reports in the pipeline
file: security_reports_spec.rb
19 0 0%
name: Govern Security Reports displays security reports in the project security dashboard
file: security_reports_spec.rb
19 0 0%
name: Govern Security Reports for dependency scanning displays the Dependency List
file: security_reports_spec.rb
19 0 0%
name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF
file: vulnerability_security_training_spec.rb
19 0 0%
name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON
file: vulnerability_security_training_spec.rb
19 0 0%
name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget
file: vulnerability_management_spec.rb
19 0 0%
name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab
file: vulnerability_management_spec.rb
19 0 0%
name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget
file: vulnerability_management_spec.rb
19 0 0%
name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget
file: vulnerability_management_spec.rb
19 0 0%
name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event
file: group_audit_event_streaming_spec.rb
13 0 0%
name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event
file: group_audit_event_streaming_spec.rb
13 0 0%
name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event
file: group_audit_event_streaming_spec.rb
13 0 0%
name: Govern Group audit event streaming with no destination adds a streaming destination
file: group_audit_event_streaming_spec.rb
13 0 0%
name: Govern Instance audit event streaming when a group is created the external server receives the event
file: instance_audit_event_streaming_spec.rb
13 0 0%
name: Govern Instance audit event streaming when a project is created the external server receives the event
file: instance_audit_event_streaming_spec.rb
13 0 0%
name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event
file: instance_audit_event_streaming_spec.rb
13 0 0%
name: Govern Instance audit event streaming when a user is created the external server receives the event
file: instance_audit_event_streaming_spec.rb
13 0 0%
name: Govern Vulnerability report in a project can export vulnerability report to csv
file: export_vulnerability_report_spec.rb
13 0 0%

manage (18)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Manage 2FA allows enforcing 2FA via UI and logging in with 2FA
file: log_in_with_2fa_spec.rb
19 0 0%
name: Manage Group access token can be used to create a file via the project API
file: group_access_token_spec.rb
19 0 0%
name: Manage Group access tokens can be created and revoked via the UI
file: group_access_token_spec.rb
19 0 0%
name: Manage Impersonation tokens can be created and revoked via the UI
file: impersonation_token_spec.rb
19 0 0%
name: Manage Project access token for a different project cannot be used to commit via the API
file: project_access_token_spec.rb
19 0 0%
name: Manage Project access token for a different project cannot be used to create a file via the project API
file: project_access_token_spec.rb
19 0 0%
name: Manage Project access token for the same project can be used to commit via the API
file: project_access_token_spec.rb
19 0 0%
name: Manage Project access token for the same project can be used to create a file via the project API
file: project_access_token_spec.rb
19 0 0%
name: Manage User when parent group membership is terminated is not allowed to commit via the API
file: user_access_termination_spec.rb
19 0 0%
name: Manage User when parent group membership is terminated is not allowed to create a file via the API
file: user_access_termination_spec.rb
19 0 0%
name: Manage User when parent group membership is terminated is not allowed to push code via the CLI
file: user_access_termination_spec.rb
19 0 0%
name: Manage User with minimal access to group is not allowed to commit via the API
file: minimal_access_user_spec.rb
19 0 0%
name: Manage User with minimal access to group is not allowed to create a file via the API
file: minimal_access_user_spec.rb
19 0 0%
name: Manage User with minimal access to group is not allowed to edit files via the UI
file: minimal_access_user_spec.rb
19 0 0%
name: Manage User with minimal access to group is not allowed to push code via the CLI
file: minimal_access_user_spec.rb
19 0 0%
name: Manage Gitlab migration with import within same instance successfully imports project
file: gitlab_migration_project_spec.rb
13 0 0%
name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab
file: jenkins_build_status_spec.rb
13 0 0%
name: Manage OIDC behaves like Instance OAuth Application creates oidc application and uses it to login
file: login_via_oauth_and_oidc_with_gitlab_as_idp_spec.rb
13 0 0%

monitor (3)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident
file: automatically_creates_incident_for_alert_spec.rb
19 0 0%
name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident
file: automatically_creates_incident_for_alert_spec.rb
19 0 0%
name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert
file: recovery_alert_resolves_correct_alert_spec.rb
19 0 0%

package (28)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Package Conan Repository publishes, installs, and deletes a Conan package
file: conan_repository_spec.rb
19 0 0%
name: Package Generic Repository uploads a generic package and downloads it
file: generic_repository_spec.rb
19 0 0%
name: Package Helm Registry using ci job token pushes and pulls a helm chart
file: helm_registry_spec.rb
19 0 0%
name: Package Helm Registry using personal access token pushes and pulls a helm chart
file: helm_registry_spec.rb
19 0 0%
name: Package Helm Registry using project deploy token pushes and pulls a helm chart
file: helm_registry_spec.rb
19 0 0%
name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle
file: maven_gradle_repository_spec.rb
19 0 0%
name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle
file: maven_gradle_repository_spec.rb
19 0 0%
name: Package Maven Repository with Gradle using project deploy token pushes and pulls a maven package via gradle
file: maven_gradle_repository_spec.rb
19 0 0%
name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates
file: maven_group_level_spec.rb
19 0 0%
name: Package Maven group level endpoint duplication setting when enabled allows users to publish duplicates
file: maven_group_level_spec.rb
19 0 0%
name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package
file: maven_group_level_spec.rb
19 0 0%
name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package
file: maven_group_level_spec.rb
19 0 0%
name: Package Maven group level endpoint via maven using a project deploy token pushes and pulls a maven package
file: maven_group_level_spec.rb
19 0 0%
name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven
file: maven_project_level_spec.rb
19 0 0%
name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven
file: maven_project_level_spec.rb
19 0 0%
name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven
file: maven_project_level_spec.rb
19 0 0%
name: Package PyPI Repository when at the project level publishes and installs a pypi package
file: pypi_repository_spec.rb
19 0 0%
name: Package RubyGems Repository publishes a Ruby gem
file: rubygems_registry_spec.rb
19 0 0%
name: Package Terraform Module Registry publishes a module
file: terraform_module_registry_spec.rb
19 0 0%
name: Package npm Registry group level endpoint using ci job token push and pull a npm package via CI
file: npm_group_level_spec.rb
19 0 0%
name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI
file: npm_group_level_spec.rb
19 0 0%
name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI
file: npm_group_level_spec.rb
19 0 0%
name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI
file: npm_instance_level_spec.rb
19 0 0%
name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI
file: npm_instance_level_spec.rb
19 0 0%
name: Package npm Registry instance level endpoint using project deploy token push and pull a npm package via CI
file: npm_instance_level_spec.rb
19 0 0%
name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI
file: npm_project_level_spec.rb
19 0 0%
name: Package npm Registry project level endpoint using personal access token push and pull a npm package via CI
file: npm_project_level_spec.rb
19 0 0%
name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI
file: npm_project_level_spec.rb
19 0 0%

plan (21)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Plan A project wiki can change the directory path of a page
file: project_based_directory_management_spec.rb
19 0 0%
name: Plan Assign Iterations assigns a group iteration to an existing issue
file: assign_group_iteration_spec.rb
19 0 0%
name: Plan Assignees update without refresh
file: real_time_assignee_spec.rb
19 0 0%
name: Plan Creating pages in group wikis when wiki has a home page adds a second page
file: create_group_wiki_page_spec.rb
19 0 0%
name: Plan Creating pages in group wikis when wiki is empty creates a new page
file: create_group_wiki_page_spec.rb
19 0 0%
name: Plan Design Management user adds a design and annotates it
file: add_design_content_spec.rb
19 0 0%
name: Plan Design Management user adds a design and modifies it
file: modify_design_content_spec.rb
19 0 0%
name: Plan Design Management user archives a design
file: archive_design_content_spec.rb
19 0 0%
name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels
file: editing_scoped_labels_spec.rb
19 0 0%
name: Plan Epics milestone dates API updates epic dates when updating milestones
file: epics_milestone_dates_spec.rb
19 0 0%
name: Plan Issue closes via pushing a commit
file: closes_issue_via_pushing_a_commit_spec.rb
19 0 0%
name: Plan Project Wiki with Wiki Page List has all expected links that work
file: project_based_list_spec.rb
19 0 0%
name: Plan Project Wiki with Wiki Sidebar has all expected links that work
file: project_based_list_spec.rb
19 0 0%
name: Plan Testing group wiki can delete a group wiki page
file: delete_group_wiki_page_spec.rb
19 0 0%
name: Plan Testing project wiki can delete a page
file: project_based_page_deletion_spec.rb
19 0 0%
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki
file: project_based_content_creation_spec.rb
19 0 0%
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push
file: project_based_content_creation_spec.rb
19 0 0%
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki
file: project_based_content_creation_spec.rb
19 0 0%
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push
file: project_based_content_creation_spec.rb
19 0 0%
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page
file: project_based_content_manipulation_spec.rb
19 0 0%
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push
file: project_based_content_manipulation_spec.rb
19 0 0%

release (5)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Release Deploy key creation user adds a deploy key
file: add_deploy_key_spec.rb
19 0 0%
name: Release Deploy token creation user adds a deploy token
file: add_deploy_token_spec.rb
19 0 0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines
file: clone_using_deploy_key_spec.rb
19 0 0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines
file: clone_using_deploy_key_spec.rb
19 0 0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines
file: clone_using_deploy_key_spec.rb
19 0 0%

secure (1)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration
file: enable_scanning_from_configuration_spec.rb
19 0 0%

verify (41)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Verify Endpoint Coverage spans r/w postgres web sidekiq git api
file: endpoint_coverage_spec.rb
19 0 0%
name: Verify Group runner registration user registers a new group runner
file: register_group_runner_spec.rb
19 0 0%
name: Verify Include multiple files from a project runs the pipeline with composed config
file: include_multiple_files_from_a_project_spec.rb
19 0 0%
name: Verify Include multiple files from multiple projects runs the pipeline with composed config
file: include_multiple_files_from_multiple_projects_spec.rb
19 0 0%
name: Verify Job artifacts are not downloaded when dependencies array is set to empty
file: job_downloads_artifacts_spec.rb
19 0 0%
name: Verify Multi-project pipelines creates a multi-project pipeline with artifact download
file: multi-project_pipelines_spec.rb
19 0 0%
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config
file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb
19 0 0%
name: Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition
file: api_variable_inheritance_with_forward_pipeline_variables_spec.rb
19 0 0%
name: Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project
file: pipeline_subscription_with_group_owned_project_spec.rb
19 0 0%
name: Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value
file: custom_variable_spec.rb
19 0 0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly
file: pipeline_with_image_pull_policy_spec.rb
19 0 0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly
file: pipeline_with_image_pull_policy_spec.rb
19 0 0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly
file: pipeline_with_image_pull_policy_spec.rb
19 0 0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly
file: pipeline_with_image_pull_policy_spec.rb
19 0 0%
name: Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message
file: pipeline_with_image_pull_policy_spec.rb
19 0 0%
name: Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined
file: prefill_variables_spec.rb
19 0 0%
name: Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page
file: prefill_variables_spec.rb
19 0 0%
name: Verify Pipeline with project file variables can read file variable content with cat
file: file_variable_spec.rb
19 0 0%
name: Verify Pipeline with project file variables does not expose file variable content with echo
file: file_variable_spec.rb
19 0 0%
name: Verify Pipeline with protected variable does not expose variable on unprotected branch
file: pipeline_with_protected_variable_spec.rb
19 0 0%
name: Verify Pipeline with protected variable exposes variable on protected branch
file: pipeline_with_protected_variable_spec.rb
19 0 0%
name: Verify Pipeline with raw variables in YAML expands variables according to expand: true/false
file: raw_variables_defined_in_yaml_spec.rb
19 0 0%
name: Verify Project artifacts when user tries bulk deletion successfully delete them
file: user_can_bulk_delete_artifacts_spec.rb
19 0 0%
name: Verify Run pipeline with manual jobs does not leave any job in skipped state
file: run_pipeline_with_manual_jobs_spec.rb
19 0 0%
name: Verify Runner fleet management shows group runner counts
file: group_runner_counts_spec.rb
19 0 0%
name: Verify Runner fleet management shows group runner online count
file: group_runner_status_counts_spec.rb
19 0 0%
name: Verify Runner registration user registers a new project runner
file: register_runner_spec.rb
19 0 0%
name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job
file: trigger_child_pipeline_with_manual_spec.rb
19 0 0%
name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables
file: trigger_matrix_spec.rb
19 0 0%
name: Verify UI defined variable is inheritable when forward:pipeline_variables is true
file: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb
19 0 0%
name: Verify UI defined variable is not inheritable by default
file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb
19 0 0%
name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false
file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb
19 0 0%
name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline
file: unlocking_job_artifacts_across_pipelines_spec.rb
19 0 0%
name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request
file: update_ci_file_with_pipeline_editor_spec.rb
19 0 0%
name: Verify When user is blocked pipeline schedule is canceled
file: cancel_pipeline_when_block_user_spec.rb
19 0 0%

Reliable specs with failures (2023-10-02 - 2023-10-16)

Total amount: 32

STAGE COUNT
create 13
data_stores 8
govern 2
plan 7
verify 2

create (13)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file
file: delete_file_from_snippet_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"snippet_action_button\"][data-qa-action=\"Edit\"],[data-qa-selector=\"snippet_action_button\"][data-qa-action=\"Edit\"]"
- submit_button did not appear on QA::Page::Dashboard::Snippet::Edit as expected
311 2 0.64%
name: Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push
file: push_protected_branch_spec.rb
Exceptions:
- expected QA::Support::Run::CommandError with message matching /You are not allowed to push code to protected branches on this project\.([\s\S]+)\[remote rejected\] protected-branch -> protected-branch \(pre-receive hook declined\)/ but nothing was...
266 1 0.38%
name: Create new merge request from the event notification after a push via the API creates a merge request
file: create_merge_request_from_push_notification_spec.rb
Exceptions:
- Wait failed after 60 seconds
266 1 0.38%
name: Create new merge request from the event notification after a push via the git CLI creates a merge request
file: create_merge_request_from_push_notification_spec.rb
Exceptions:
- Wait failed after 60 seconds
266 1 0.38%
name: Create Batch comments in merge request user submits a non-diff review
file: add_batch_comments_in_merge_request_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"comment_field\"],[data-qa-selector=\"comment_field\"]"
311 1 0.32%
name: Create Cherry picking from a merge request creates a merge request
file: cherry_pick_a_merge_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"
311 1 0.32%
name: Create Commit data user views raw commit diff
file: user_views_commit_diff_patch_spec.rb
Exceptions:
- Fabrication of QA::Resource::File using the API failed (400) with '{"message":"13:update reference: running pre-receive hooks: calling pre_receive endpoint: http post to gitlab api /pre_receive endpoint: Internal API error (503)."}'.Correlation Id...
- Timed out waiting for event
311 1 0.32%
name: Create Commit data user views raw email patch
file: user_views_commit_diff_patch_spec.rb
Exceptions:
- Fabrication of QA::Resource::File using the API failed (400) with '{"message":"13:update reference: running pre-receive hooks: calling pre_receive endpoint: http post to gitlab api /pre_receive endpoint: Internal API error (503)."}'.Correlation Id...
- Timed out waiting for event
311 1 0.32%
name: Create File management user creates a file via the Web
file: create_file_via_web_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"commit_button\"],[data-qa-selector=\"commit_button\"]"
311 1 0.32%
name: Create Merge request batch suggestions applies multiple suggestions
file: batch_suggestion_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"reply_field\"],[data-qa-selector=\"reply_field\"]"
311 1 0.32%
name: Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file
file: delete_file_from_snippet_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"snippet_action_button\"][data-qa-action=\"Edit\"],[data-qa-selector=\"snippet_action_button\"][data-qa-action=\"Edit\"]"
- submit_button did not appear on QA::Page::Dashboard::Snippet::Edit as expected
311 1 0.32%
name: Create Multiple file snippet creates a project snippet with multiple files
file: create_project_snippet_with_multiple_files_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"svg_content\"],[data-qa-selector=\"svg_content\"]"
311 1 0.32%
name: Create Reverting a commit creates a merge request
file: revert_commit_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"file_tree_button\"],[data-qa-selector=\"file_tree_button\"]"
311 1 0.32%

data_stores (8)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Data Stores User when added to parent group is allowed to push code to sub-group project via the CLI
file: user_inherited_access_spec.rb
Exceptions:
- expected no Exception, got #<QA::Support::Run::CommandError: The command HOME="/tmp/qa-netrc-credentials/27" git push https://qa...ub-groupd-project-to-test-user-access-d32d5d0b41d032eb.git/': The requested URL returned error: 403> with backtrace:...
- expected no Exception, got #<QA::Support::Run::CommandError: The command HOME="/tmp/qa-netrc-credentials/27" git push https://qa...ub-groupd-project-to-test-user-access-146720b314394400.git/': The requested URL returned error: 403> with backtrace:...
199 2 1.01%
name: Data Stores Project owner permissions for personal projects behaves like adds user as owner has owner role and permissions
file: project_owner_permissions_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project-content\"],[data-qa-selector=\"project-content\"]"
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 2 0.66%
name: Data Stores Invite group with a group project behaves like invites group to project grants group and members correct access level
file: invite_group_to_project_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 1 0.33%
name: Data Stores Invite group with a personal namespace project behaves like invites group to project grants group and members correct access level
file: invite_group_to_project_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 1 0.33%
name: Data Stores Project owner permissions for group projects behaves like adds user as maintainer has maintainer role without owner permissions
file: project_owner_permissions_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 1 0.33%
name: Data Stores Project owner permissions for group projects behaves like adds user as owner has owner role and permissions
file: project_owner_permissions_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 1 0.33%
name: Data Stores Project owner permissions for personal projects behaves like adds user as maintainer has maintainer role without owner permissions
file: project_owner_permissions_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_filter_form_container\"],[data-qa-selector=\"project_filter_form_container\"]"
305 1 0.33%
name: Data Stores Project transfer user transfers a project between groups
file: transfer_project_spec.rb
Exceptions:
- expected 'QA::Page::Project::Show.has_readme_content?("Here is the edited content.")' to be truthy, got false
305 1 0.33%

govern (2)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations
file: group_audit_logs_1_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"user_action_dropdown\"],[data-qa-selector=\"user_action_dropdown\"]" within #<Capybara::Node::Element tag="tr" path="/HTML/BODY[1]/DIV[1]/DIV[4]/DIV[3]/MAIN[1]/DIV[2]/DIV[1]/DIV[2]/DIV[2]/DIV[1]/DIV[1]/DIV[2]/TAB...
- Unable to find css "[data-testid=\"search_bar_input\"],[data-qa-selector=\"search_bar_input\"]"
311 2 0.64%
name: Govern Project for add project behaves like audit event logs audit events for UI operations
file: project_audit_logs_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"project_id_content\"],[data-qa-selector=\"project_id_content\"]"
311 1 0.32%

plan (7)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Plan Burndown chart shows burndown chart on milestone page
file: burndown_chart_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"burndown_chart\"],[data-qa-selector=\"burndown_chart\"]"
311 2 0.64%
name: Plan Epics Management Resources created via API Visit epic first closes and reopens an epic
file: epics_management_spec.rb
Exceptions:
- expected QA::EE::Page::Group::Epic::Show to have system note "closed"
311 2 0.64%
name: Plan Epics Management Resources created via API Visit epic first comments on epic
file: epics_management_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"discussion_preferences_dropdown\"],[data-qa-selector=\"discussion_preferences_dropdown\"]"
311 2 0.64%
name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions
file: epics_management_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"discussion_preferences_dropdown\"],[data-qa-selector=\"discussion_preferences_dropdown\"]"
311 2 0.64%
name: Plan collapse comments in issue discussions collapses and expands reply for comments in an issue
file: collapse_comments_in_discussions_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"discussion_preferences_dropdown\"],[data-qa-selector=\"discussion_preferences_dropdown\"]"
311 1 0.32%
name: Plan filter issue comments activities filters comments and activities in an issue
file: filter_issue_comments_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"discussion_preferences_dropdown\"],[data-qa-selector=\"discussion_preferences_dropdown\"]"
311 1 0.32%
name: Plan promote issue to epic promotes issue to epic
file: promote_issue_to_epic_spec.rb
Exceptions:
- Unable to find css "[data-testid=\"discussion_preferences_dropdown\"],[data-qa-selector=\"discussion_preferences_dropdown\"]"
311 1 0.32%

verify (2)

Executions table
NAME RUNS FAILURES FAILURE RATE
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results
file: pipelines_for_merged_results_and_merge_trains_spec.rb
Exceptions:
- Wait failed after 120 seconds
311 1 0.32%
name: Verify Pipelines for merged results and merge trains merges via a merge train
file: pipelines_for_merged_results_and_merge_trains_spec.rb
Exceptions:
- Wait failed after 120 seconds
311 1 0.32%