Reliable e2e test report

• Candidates for promotion to reliable (2023-07-03 - 2023-07-17)
  • analytics (2)
  • create (99)
  • unknown (14)
  • data_stores (23)
  • fulfillment (2)
  • govern (24)
  • manage (17)
  • monitor (3)
  • package (18)
  • plan (25)
  • release (6)
  • secure (1)
  • verify (39)
• Reliable specs with failures (2023-07-03 - 2023-07-17)
  • create (9)
  • data_stores (7)
  • govern (10)
  • manage (3)
  • plan (18)
  • verify (7)

Candidates for promotion to reliable (2023-07-03 - 2023-07-17)

Total amount: 273

STAGE	COUNT
analytics	2
create	99
unknown	14
data_stores	23
fulfillment	2
govern	24
manage	17
monitor	3
package	18
plan	25
release	6
secure	1
verify	39

analytics (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled file: service_ping_default_enabled_spec.rb	59	0	0%
name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests file: performance_bar_spec.rb	42	0	0%

create (99)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly file: branch_with_unusual_name_spec.rb	60	0	0%
name: Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different file: project_archive_compare_spec.rb	60	0	0%
name: Create Create a new merge request creates a merge request with a milestone and label file: create_merge_request_spec.rb	60	0	0%
name: Create Merge request creation from fork can merge source branch from fork into upstream repository file: merge_merge_request_from_fork_spec.rb	60	0	0%
name: Create Merge request push options sets title and description file: push_options_title_description_spec.rb	60	0	0%
name: Create Merge request rebasing user rebases source branch of merge request file: rebase_merge_request_spec.rb	60	0	0%
name: Create Merge request squashing user squashes commits while merging file: squash_merge_request_spec.rb	60	0	0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file file: add_file_to_snippet_spec.rb	60	0	0%
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file file: add_file_to_snippet_spec.rb	60	0	0%
name: Create Project snippet creation user creates a project snippet file: create_project_snippet_spec.rb	60	0	0%
name: Create Project templates when built-in successfully imports the project using template file: project_templates_spec.rb	60	0	0%
name: Create Project templates when group level successfully imports the project using template file: project_templates_spec.rb	60	0	0%
name: Create Push over SSH using Git protocol version 2 user pushes to the repository file: protocol_v2_push_ssh_spec.rb	60	0	0%
name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb	60	0	0%
name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb	60	0	0%
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb	60	0	0%
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb	60	0	0%
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb	60	0	0%
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb	60	0	0%
name: Create batch comments in merge request user submits a diff review file: add_batch_comments_in_merge_request_spec.rb	60	0	0%
name: Create batch comments in merge request user submits a non-diff review file: add_batch_comments_in_merge_request_spec.rb	60	0	0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet file: add_comment_to_snippet_spec.rb	59	0	0%
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet file: add_comment_to_snippet_spec.rb	59	0	0%
name: Create Approval rules allows multiple approval rules with users and groups file: approval_rules_spec.rb	59	0	0%
name: Create Codeowners displays owners specified in CODEOWNERS file file: code_owners_spec.rb	59	0	0%
name: Create Commit data user views raw commit diff file: user_views_commit_diff_patch_spec.rb	59	0	0%
name: Create Commit data user views raw email patch file: user_views_commit_diff_patch_spec.rb	59	0	0%
name: Create Create a new merge request from the event notification after a push creates a merge request after a push via the API file: create_merge_request_from_push_notification_spec.rb	59	0	0%
name: Create Create a new merge request from the event notification after a push creates a merge request after a push via the git CLI file: create_merge_request_from_push_notification_spec.rb	59	0	0%
name: Create Create a new project from a template commits via the api file: commit_to_templated_project_spec.rb	59	0	0%
name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches file: add_list_delete_branches_spec.rb	59	0	0%
name: Create Download merge request patch and diff views the merge request patches file: view_merge_request_diff_patch_spec.rb	59	0	0%
name: Create Download merge request patch and diff views the merge request plain diff file: view_merge_request_diff_patch_spec.rb	59	0	0%
name: Create File templates user adds .gitignore via file template Android file: add_file_template_spec.rb	59	0	0%
name: Create File templates user adds .gitlab-ci.yml via file template Julia file: add_file_template_spec.rb	59	0	0%
name: Create File templates user adds Dockerfile via file template Python file: add_file_template_spec.rb	59	0	0%
name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 file: add_file_template_spec.rb	59	0	0%
name: Create Git clone over HTTP user performs a deep clone file: clone_spec.rb	59	0	0%
name: Create Git clone over HTTP user performs a shallow clone file: clone_spec.rb	59	0	0%
name: Create Merge request push options removes the source branch file: push_options_remove_source_branch_spec.rb	59	0	0%
name: Create Merge request push options sets a target branch file: push_options_target_branch_spec.rb	59	0	0%
name: Create Merged merge request can be reverted file: reverting_merge_request_spec.rb	59	0	0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb	59	0	0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number file: snippet_index_page_spec.rb	59	0	0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb	59	0	0%
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number file: snippet_index_page_spec.rb	59	0	0%
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI file: clone_push_pull_project_snippet_spec.rb	59	0	0%
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI file: clone_push_pull_project_snippet_spec.rb	59	0	0%
name: Create with merge request suggestions applies a single suggestion with a custom message file: custom_commit_suggestion_spec.rb	59	0	0%
name: Create API basics raw file access sets no-cache headers as expected file: files_spec.rb	58	0	0%
name: Create API basics user creates a project with a file and deletes them afterwards file: files_spec.rb	58	0	0%
name: Create Branch Rules Overview adds a new branch rule file: add_new_branch_rule_spec.rb	58	0	0%
name: Create Cherry picking a commit creates a merge request file: cherry_pick_commit_spec.rb	58	0	0%
name: Create Default merge request templates uses default template when creating a merge request file: default_merge_request_template_spec.rb	58	0	0%
name: Create File Locking checks file locked by other user to be disabled file: file_locking_spec.rb	58	0	0%
name: Create File Locking creates a merge request and fails to merge file: file_locking_spec.rb	58	0	0%
name: Create File Locking locks a directory and tries to push as a second user file: file_locking_spec.rb	58	0	0%
name: Create File Locking locks a file and tries to push as a second user file: file_locking_spec.rb	58	0	0%
name: Create File Locking locks a file and unlocks in list file: file_locking_spec.rb	58	0	0%
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly file: file_with_unusual_name_spec.rb	58	0	0%
name: Create Group file templates creates file via custom .gitignore file template file: group_file_template_spec.rb	58	0	0%
name: Create Group file templates creates file via custom .gitlab-ci.yml file template file: group_file_template_spec.rb	58	0	0%
name: Create Group file templates creates file via custom Dockerfile file template file: group_file_template_spec.rb	58	0	0%
name: Create Group file templates creates file via custom LICENSE file template file: group_file_template_spec.rb	58	0	0%
name: Create Merge request push options sets merge when pipeline succeeds file: push_options_mwps_spec.rb	58	0	0%
name: Create PostReceive idempotent pushes and creates a single push event three times file: push_postreceive_idempotent_spec.rb	58	0	0%
name: Create Push Rules using non signed commits allows an unrestricted push file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts branches by branch name file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts commit by message format file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts committing files with secrets file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts files by name and size file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts removal of tag file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using non signed commits restricts users by email format file: push_rules_spec.rb	58	0	0%
name: Create Push Rules using signed commits restricts to signed commits file: push_rules_spec.rb	58	0	0%
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users file: push_rules_spec.rb	58	0	0%
name: Create Push Rules with commits restricted to verified emails rejects unverified emails file: push_rules_spec.rb	58	0	0%
name: Create Push mirror a repository over HTTP configures and syncs LFS objects for a (push) mirrored repository file: push_mirroring_lfs_over_http_spec.rb	58	0	0%
name: Create Push mirror a repository over HTTP configures and syncs a (push) mirrored repository file: push_mirroring_over_http_spec.rb	58	0	0%
name: Create Push over HTTP using Git protocol version 2 user pushes to the repository file: protocol_v2_push_http_spec.rb	58	0	0%
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled file: code_owners_with_protected_branch_and_squashed_commits_spec.rb	58	0	0%
name: Create Source editor toolbar preview can preview markdown side-by-side while editing file: source_editor_toolbar_spec.rb	58	0	0%
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI file: clone_push_pull_personal_snippet_spec.rb	58	0	0%
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI file: clone_push_pull_personal_snippet_spec.rb	58	0	0%
name: Create File management user deletes a file via the Web file: delete_file_via_web_spec.rb	57	0	0%
name: Create Merge request push options sets labels file: push_options_labels_spec.rb	57	0	0%
name: Create Merge request push options when labels are set already removes them on subsequent push file: push_options_labels_spec.rb	57	0	0%
name: Create Pull mirror a repository over HTTP configures and syncs a (pull) mirrored repository with password auth file: pull_mirroring_over_http_spec.rb	57	0	0%
name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository file: pull_mirroring_over_ssh_with_key_spec.rb	53	0	0%
name: Create Upload a file in Web IDE when a file with the same name already exists throws an error file: upload_new_file_in_web_ide_spec.rb	44	0	0%
name: Create Upload a file in Web IDE when the file is an image behaves like upload a file verifies it successfully uploads and commits to a MR file: upload_new_file_in_web_ide_spec.rb	44	0	0%
name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error file: add_new_directory_in_web_ide_spec.rb	43	0	0%
name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed file: add_new_directory_in_web_ide_spec.rb	43	0	0%
name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name file: default_branch_name_setting_spec.rb	42	0	0%
name: Create Default branch name instance setting sets the default branch name for a new project file: default_branch_name_setting_spec.rb	42	0	0%
name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error file: tag_revision_trigger_prereceive_hook_spec.rb	42	0	0%
name: Create Repository Usage Quota matches cloned repo usage to reported usage file: storage_size_spec.rb	42	0	0%
name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit file: push_over_http_file_size_spec.rb	42	0	0%
name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit file: push_over_http_file_size_spec.rb	42	0	0%
name: Create PostReceive idempotent repeatedly pushes and creates a single push event several times file: push_postreceive_idempotent_spec.rb	12	0	0%

unknown (14)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	58	0	0%
name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	58	0	0%
name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	58	0	0%
name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	58	0	0%
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_shared_examples.rb	58	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with a CE feature flag with a default disabled feature flag reads as enabled after the flag is enabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with a CE feature flag with a default disabled feature flag reads the flag as disabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with a CE feature flag with a default enabled feature flag reads as disabled after the flag is disabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with a CE feature flag with a default enabled feature flag reads the flag as enabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with an EE feature flag with a default disabled feature flag reads as enabled after the flag is enabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with an EE feature flag with a default disabled feature flag reads the flag as disabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with an EE feature flag with a default enabled feature flag reads as disabled after the flag is disabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks feature flag definition files with an EE feature flag with a default enabled feature flag reads the flag as enabled file: feature_flags_spec.rb	12	0	0%
name: Framework sanity Feature flag handler checks with an existing feature flag definition file reads the correct default enabled state file: feature_flags_spec.rb	12	0	0%

data_stores (23)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user file: elasticsearch_api_spec.rb	116	0	0%
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description file: advanced_global_advanced_syntax_search_spec.rb	60	0	0%
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name file: advanced_global_advanced_syntax_search_spec.rb	60	0	0%
name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message file: commit_index_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user file: elasticsearch_api_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user file: elasticsearch_api_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content file: blob_index_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description file: issue_index_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description file: merge_request_index_spec.rb	60	0	0%
name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body file: note_index_spec.rb	60	0	0%
name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API file: user_inherited_access_spec.rb	57	0	0%
name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API file: user_inherited_access_spec.rb	57	0	0%
name: Data Stores Subgroup transfer transfers a subgroup to another group file: transfer_group_spec.rb	56	0	0%
name: Data Stores When using advanced search API to search for a user finds the user that matches username file: user_index_spec.rb	56	0	0%
name: Data Stores prevent forking outside group when disabled allows forking outside of group file: prevent_forking_outside_group_spec.rb	56	0	0%
name: Data Stores prevent forking outside group when enabled does not allow forking outside of group file: prevent_forking_outside_group_spec.rb	56	0	0%
name: Data Stores Group member access request generates a todo item for the group owner file: group_member_access_request_spec.rb	55	0	0%
name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group file: group_member_access_request_spec.rb	55	0	0%
name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group file: group_member_access_request_spec.rb	55	0	0%
name: Data Stores Group with members can be shared with another group with correct access level file: share_group_with_group_spec.rb	55	0	0%
name: Data Stores User can be followed and their activity seen file: follow_user_activity_spec.rb	54	0	0%
name: Data Stores User when added to parent group is allowed to edit the sub-group project files file: user_inherited_access_spec.rb	54	0	0%
name: Data Stores User when added to sub-group is not allowed to edit the parent group project files file: user_inherited_access_spec.rb	54	0	0%

fulfillment (2)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Fulfillment Active license details shows up in subscription page file: license_spec.rb	42	0	0%
name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license file: user_registration_billing_spec.rb	42	0	0%

govern (24)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned file: compliance_pipeline_spec.rb	60	0	0%
name: Govern Group for change project creation level behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	60	0	0%
name: Govern Project vulnerability report validates "fix a vulnerability" workflow file: fix_vulnerability_workflow_spec.rb	60	0	0%
name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab file: vulnerability_management_spec.rb	59	0	0%
name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget file: vulnerability_management_spec.rb	59	0	0%
name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget file: vulnerability_management_spec.rb	59	0	0%
name: Govern project vulnerability report can bulk dismiss vulnerabilities as false positive in vulnerability report file: change_vulnerability_status_spec.rb	59	0	0%
name: Govern project vulnerability report can successfully bulk change status to confirmed in vulnerability report file: change_vulnerability_status_spec.rb	59	0	0%
name: Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page file: change_vulnerability_status_spec.rb	59	0	0%
name: Govern Security Reports dependency list has empty state file: security_reports_spec.rb	57	0	0%
name: Govern Security Reports displays security reports in the pipeline file: security_reports_spec.rb	57	0	0%
name: Govern Security Reports displays the Dependency List file: security_reports_spec.rb	57	0	0%
name: Govern Group for add group behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb	56	0	0%
name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF file: vulnerability_security_training_spec.rb	46	0	0%
name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON file: vulnerability_security_training_spec.rb	46	0	0%
name: Govern Compliance Framework Report shows the compliance framework for each project file: compliance_framework_report_spec.rb	42	0	0%
name: Govern Instance for add SSH key behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Instance for add and delete email behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Instance for change password behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Instance for failed sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Instance for start and stop user impersonation behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Instance for successful sign in behaves like audit event logs audit events for UI operations file: instance_audit_logs_spec.rb	42	0	0%
name: Govern Vulnerability report in a project can export vulnerability report to csv file: export_vulnerability_report_spec.rb	42	0	0%
name: Govern compliance dashboard with separation of duties in an MR when there is only one approval from a user other than the author shows only "less than two approvers" violation file: group_compliance_dashboard_spec.rb	42	0	0%

manage (17)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Manage Group access token can be used to create a file via the project API file: group_access_token_spec.rb	60	0	0%
name: Manage Impersonation tokens can be created and revoked via the UI file: impersonation_token_spec.rb	59	0	0%
name: Manage Project access token for a different project cannot be used to commit via the API file: project_access_token_spec.rb	59	0	0%
name: Manage Project access token for a different project cannot be used to create a file via the project API file: project_access_token_spec.rb	59	0	0%
name: Manage Project access token for the same project can be used to commit via the API file: project_access_token_spec.rb	59	0	0%
name: Manage Project access token for the same project can be used to create a file via the project API file: project_access_token_spec.rb	59	0	0%
name: Manage User with minimal access to group is not allowed to edit files via the UI file: minimal_access_user_spec.rb	59	0	0%
name: Manage Group access tokens can be created and revoked via the UI file: group_access_token_spec.rb	58	0	0%
name: Manage User after parent group membership termination is not allowed to commit via the API file: user_access_termination_spec.rb	58	0	0%
name: Manage User after parent group membership termination is not allowed to create a file via the API file: user_access_termination_spec.rb	58	0	0%
name: Manage User after parent group membership termination is not allowed to push code via the CLI file: user_access_termination_spec.rb	58	0	0%
name: Manage User with minimal access to group is not allowed to commit via the API file: minimal_access_user_spec.rb	57	0	0%
name: Manage User with minimal access to group is not allowed to create a file via the API file: minimal_access_user_spec.rb	57	0	0%
name: Manage User with minimal access to group is not allowed to push code via the CLI file: minimal_access_user_spec.rb	57	0	0%
name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab file: jenkins_build_status_spec.rb	42	0	0%
name: Manage OAuth behaves like Instance OAuth Application creates oauth application and uses it to login file: login_via_oauth_and_oidc_with_gitlab_as_idp_spec.rb	42	0	0%
name: Manage OIDC behaves like Instance OAuth Application creates oidc application and uses it to login file: login_via_oauth_and_oidc_with_gitlab_as_idp_spec.rb	42	0	0%

monitor (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident file: automatically_creates_incident_for_alert_spec.rb	60	0	0%
name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident file: automatically_creates_incident_for_alert_spec.rb	60	0	0%
name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert file: recovery_alert_resolves_correct_alert_spec.rb	58	0	0%

package (18)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Package NuGet project level endpoint using a ci job token publishes a nuget package and installs file: nuget_project_level_spec.rb	46	0	0%
name: Package NuGet project level endpoint using a personal access token publishes a nuget package and installs file: nuget_project_level_spec.rb	46	0	0%
name: Package NuGet project level endpoint using a project deploy token publishes a nuget package and installs file: nuget_project_level_spec.rb	46	0	0%
name: Package Package Registry npm project level endpoint using ci job token push and pull a npm package via CI file: npm_project_level_spec.rb	46	0	0%
name: Package Package Registry npm project level endpoint using personal access token push and pull a npm package via CI file: npm_project_level_spec.rb	46	0	0%
name: Package Package Registry npm project level endpoint using project deploy token push and pull a npm package via CI file: npm_project_level_spec.rb	46	0	0%
name: Package RubyGems Repository publishes a Ruby gem file: rubygems_registry_spec.rb	46	0	0%
name: Package Generic Repository uploads a generic package and downloads it file: generic_repository_spec.rb	45	0	0%
name: Package Package Registry npm group level endpoint using ci job token push and pull a npm package via CI file: npm_group_level_spec.rb	45	0	0%
name: Package Package Registry npm group level endpoint using personal access token push and pull a npm package via CI file: npm_group_level_spec.rb	45	0	0%
name: Package Package Registry npm group level endpoint using project deploy token push and pull a npm package via CI file: npm_group_level_spec.rb	45	0	0%
name: Package Package Registry npm instance level endpoint using ci job token push and pull a npm package via CI file: npm_instance_level_spec.rb	45	0	0%
name: Package Package Registry npm instance level endpoint using personal access token push and pull a npm package via CI file: npm_instance_level_spec.rb	45	0	0%
name: Package Package Registry npm instance level endpoint using project deploy token push and pull a npm package via CI file: npm_instance_level_spec.rb	45	0	0%
name: Package Composer Repository publishes a composer package and deletes it file: composer_registry_spec.rb	43	0	0%
name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	43	0	0%
name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	43	0	0%
name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb	43	0	0%

plan (25)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Plan Contribution Analytics tests contributions file: contribution_analytics_spec.rb	60	0	0%
name: Plan Design Management user archives a design file: archive_design_content_spec.rb	60	0	0%
name: Plan Project Wiki with Wiki Page List has all expected links that work file: project_based_list_spec.rb	60	0	0%
name: Plan Project Wiki with Wiki Sidebar has all expected links that work file: project_based_list_spec.rb	60	0	0%
name: Plan A project wiki can change the directory path of a page file: project_based_directory_management_spec.rb	59	0	0%
name: Plan Assign Iterations assigns a group iteration to an existing issue file: assign_group_iteration_spec.rb	59	0	0%
name: Plan Creating pages in group wikis when wiki has a home page adds a second page file: create_group_wiki_page_spec.rb	59	0	0%
name: Plan Creating pages in group wikis when wiki is empty creates a new page file: create_group_wiki_page_spec.rb	59	0	0%
name: Plan Design Management user adds a design and modifies it file: modify_design_content_spec.rb	59	0	0%
name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels file: editing_scoped_labels_spec.rb	59	0	0%
name: Plan Group Iterations creates a group iteration automatically through an iteration cadence file: create_group_iteration_spec.rb	59	0	0%
name: Plan Issue closes via pushing a commit file: closes_issue_via_pushing_a_commit_spec.rb	59	0	0%
name: Plan Testing project wiki can delete a page file: project_based_page_deletion_spec.rb	59	0	0%
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki file: project_based_content_creation_spec.rb	59	0	0%
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push file: project_based_content_creation_spec.rb	59	0	0%
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki file: project_based_content_creation_spec.rb	59	0	0%
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push file: project_based_content_creation_spec.rb	59	0	0%
name: Plan Assignees update without refresh file: real_time_assignee_spec.rb	58	0	0%
name: Plan Epics milestone dates API updates epic dates when updating milestones file: epics_milestone_dates_spec.rb	58	0	0%
name: Plan Testing group wiki can delete a group wiki page file: delete_group_wiki_page_spec.rb	58	0	0%
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page file: project_based_content_manipulation_spec.rb	58	0	0%
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push file: project_based_content_manipulation_spec.rb	58	0	0%
name: Plan Design Management user adds a design and annotates it file: add_design_content_spec.rb	57	0	0%
name: Plan Testing group wiki file upload by creating a formatted page with an image uploaded file: file_upload_group_wiki_page_spec.rb	45	0	0%
name: Plan Discussion comments transient bugs comments with mention on a discussion in an issue file: comment_on_discussion_spec.rb	13	0	0%

release (6)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Release Operations Dashboard has many pipelines with appropriate statuses file: pipeline_status_on_operation_dashboard_spec.rb	59	0	0%
name: Release Deploy key creation user adds a deploy key file: add_deploy_key_spec.rb	58	0	0%
name: Release Deploy token creation user adds a deploy token file: add_deploy_token_spec.rb	58	0	0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines file: clone_using_deploy_key_spec.rb	58	0	0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines file: clone_using_deploy_key_spec.rb	58	0	0%
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines file: clone_using_deploy_key_spec.rb	58	0	0%

secure (1)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration file: enable_scanning_from_configuration_spec.rb	60	0	0%

verify (39)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Verify Include multiple files from multiple projects runs the pipeline with composed config file: include_multiple_files_from_multiple_projects_spec.rb	60	0	0%
name: Verify Pipeline editor can create merge request file: pipeline_editor_can_create_merge_request_spec.rb	60	0	0%
name: Verify Run pipeline with manual jobs does not leave any job in skipped state file: run_pipeline_with_manual_jobs_spec.rb	60	0	0%
name: Verify UI defined variable is inheritable when forward:pipeline_variables is true file: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb	60	0	0%
name: Verify UI defined variable is not inheritable by default file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb	60	0	0%
name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb	60	0	0%
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	60	0	0%
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	60	0	0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	60	0	0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	60	0	0%
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb	60	0	0%
name: Verify Code coverage statistics creates an MR with code coverage statistics file: view_code_coverage_spec.rb	59	0	0%
name: Verify Include multiple files from a project runs the pipeline with composed config file: include_multiple_files_from_a_project_spec.rb	59	0	0%
name: Verify Multi-project pipelines creates a multi-project pipeline with artifact download file: multi-project_pipelines_spec.rb	59	0	0%
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb	59	0	0%
name: Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition file: api_variable_inheritance_with_forward_pipeline_variables_spec.rb	59	0	0%
name: Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project file: pipeline_subscription_with_group_owned_project_spec.rb	59	0	0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb	59	0	0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb	59	0	0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb	59	0	0%
name: Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb	59	0	0%
name: Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message file: pipeline_with_image_pull_policy_spec.rb	59	0	0%
name: Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined file: prefill_variables_spec.rb	59	0	0%
name: Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page file: prefill_variables_spec.rb	59	0	0%
name: Verify Pipeline with protected variable does not expose variable on unprotected branch file: pipeline_with_protected_variable_spec.rb	59	0	0%
name: Verify Pipeline with protected variable exposes variable on protected branch file: pipeline_with_protected_variable_spec.rb	59	0	0%
name: Verify Pipeline with raw variables in YAML expands variables according to expand: true/false file: raw_variables_defined_in_yaml_spec.rb	59	0	0%
name: Verify Runner registration user registers a new project runner file: register_runner_spec.rb	59	0	0%
name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job file: trigger_child_pipeline_with_manual_spec.rb	59	0	0%
name: Verify Update CI file with pipeline editor creates new pipeline and target branch file: update_ci_file_with_pipeline_editor_spec.rb	59	0	0%
name: Verify When user is blocked pipeline schedule is canceled file: cancel_pipeline_when_block_user_spec.rb	59	0	0%
name: Verify Endpoint Coverage spans r/w postgres web sidekiq git api file: endpoint_coverage_spec.rb	58	0	0%
name: Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value file: custom_variable_spec.rb	58	0	0%
name: Verify Pipeline with project file variables can read file variable content with cat file: file_variable_spec.rb	58	0	0%
name: Verify Pipeline with project file variables does not expose file variable content with echo file: file_variable_spec.rb	58	0	0%
name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables file: trigger_matrix_spec.rb	58	0	0%
name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline file: unlocking_job_artifacts_across_pipelines_spec.rb	58	0	0%
name: Verify Group runner registration user registers a new group runner file: register_group_runner_spec.rb	46	0	0%
name: Verify Merge trains transient bugs confirms that a merge train consistently completes and updates the UI file: merge_trains_transient_bug_spec.rb	13	0	0%

Reliable specs with failures (2023-07-03 - 2023-07-17)

Total amount: 54

STAGE	COUNT
create	9
data_stores	7
govern	10
manage	3
plan	18
verify	7

create (9)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user file: protected_tags_spec.rb	389	2	0.51%
name: Create File management user creates a file via the Web file: create_file_via_web_spec.rb	388	1	0.26%
name: Create Merge request custom templates creates a merge request via custom template file: create_merge_request_via_template_spec.rb	389	1	0.26%
name: Create Multiple file snippet behaves like copying snippet file contents copies file contents of a multi-file project_snippet to a comment and verifies them file: copy_snippet_file_contents_spec.rb	388	1	0.26%
name: Create Multiple file snippet creates a personal snippet with multiple files file: create_personal_snippet_with_multiple_files_spec.rb	389	1	0.26%
name: Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user file: protected_tags_spec.rb	389	1	0.26%
name: Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown file: share_snippet_spec.rb	390	1	0.26%
name: Create Sharing snippets when the snippet is public can be shared with not signed-in users file: share_snippet_spec.rb	390	1	0.26%
name: Create with merge request batch suggestions applies multiple suggestions file: batch_suggestion_spec.rb	390	1	0.26%

data_stores (7)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Data Stores Invite group with a group project behaves like invites group to project verifies group is added and members can access project with correct access level file: invite_group_to_project_spec.rb	384	1	0.26%
name: Data Stores Invite group with a personal namespace project behaves like invites group to project verifies group is added and members can access project with correct access level file: invite_group_to_project_spec.rb	384	1	0.26%
name: Data Stores Project activity user creates an event in the activity page upon Git push file: view_project_activity_spec.rb	386	1	0.26%
name: Data Stores Project owner permissions for group projects behaves like when user is added as maintainer has maintainer role without owner permissions file: project_owner_permissions_spec.rb	383	1	0.26%
name: Data Stores Users API GET /users file: users_spec.rb	388	1	0.26%
name: Data Stores Users API GET /users/:username with a valid username file: users_spec.rb	388	1	0.26%
name: Data Stores Users API GET /users/:username with an invalid username file: users_spec.rb	388	1	0.26%

govern (10)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab file: vulnerability_management_spec.rb	389	5	1.29%
name: Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb	386	3	0.78%
name: Govern Security Dashboard in a Project shows vulnerability details file: project_security_dashboard_spec.rb	387	2	0.52%
name: Govern Group for add and remove project access behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb	386	1	0.26%
name: Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	390	1	0.26%
name: Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations file: group_audit_logs_2_spec.rb	390	1	0.26%
name: Govern Group for update group name behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb	386	1	0.26%
name: Govern Project for change visibility behaves like audit event logs audit events for UI operations file: project_audit_logs_spec.rb	388	1	0.26%
name: Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy file: scan_result_policy_vulnerabilities_spec.rb	388	1	0.26%
name: Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget file: create_merge_request_with_secure_spec.rb	389	1	0.26%

manage (3)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Manage standard when admin approval is not required behaves like registration and login allows the user to register and login file: register_spec.rb	56	14	25.0%
name: Manage standard when admin approval is not required when user account is deleted allows recreating with same credentials file: register_spec.rb	56	14	25.0%
name: Manage standard when admin approval is required allows user login after approval file: register_spec.rb	56	14	25.0%

plan (18)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Plan Custom email customizes email with additional text file: custom_email_spec.rb	213	14	6.57%
name: Plan Burndown chart shows burndown chart on milestone page file: burndown_chart_spec.rb	390	1	0.26%
name: Plan Configurable issue board renames the issue board file: configurable_issue_board_spec.rb	389	1	0.26%
name: Plan Configure issue board by label shows only issues that match the configured label file: configure_issue_board_by_label_spec.rb	390	1	0.26%
name: Plan Custom issue templates creates an issue via custom template file: custom_issue_template_spec.rb	389	1	0.26%
name: Plan Default issue templates uses default template when creating an issue file: default_issue_template_spec.rb	389	1	0.26%
name: Plan Epics roadmap presents epic on roadmap file: roadmap_spec.rb	389	1	0.26%
name: Plan Group issue boards creates a group issue board via the GUI file: create_group_issue_board_spec.rb	390	1	0.26%
name: Plan Group milestone creates a group milestone file: create_group_milestone_spec.rb	389	1	0.26%
name: Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page file: issue_weight_visualization_spec.rb	390	1	0.26%
name: Plan Milestones Project milestone behaves like milestone assigned to existing issue is assigned to an existing issue file: assign_milestone_spec.rb	389	1	0.26%
name: Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it file: project_issue_boards_spec.rb	389	1	0.26%
name: Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it file: project_issue_boards_spec.rb	389	1	0.26%
name: Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it file: project_issue_boards_spec.rb	389	1	0.26%
name: Plan Related issues relates and unrelates one issue to/from another file: related_issues_spec.rb	387	1	0.26%
name: Plan filter issue comments activities filters comments and activities in an issue file: filter_issue_comments_spec.rb	389	1	0.26%
name: Plan for group insights page behaves like default insights page displays issues and merge requests dashboards file: default_insights_spec.rb	390	1	0.26%
name: Plan for project insights page behaves like default insights page displays issues and merge requests dashboards file: default_insights_spec.rb	390	1	0.26%

verify (7)

Executions table

NAME	RUNS	FAILURES	FAILURE RATE
name: Verify Include local config file paths with wildcard runs the pipeline with composed config file: include_local_config_file_paths_with_wildcard_spec.rb	387	1	0.26%
name: Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails file: parent_child_pipelines_dependent_relationship_spec.rb	389	1	0.26%
name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes file: parent_child_pipelines_dependent_relationship_spec.rb	389	1	0.26%
name: Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails file: parent_child_pipelines_independent_relationship_spec.rb	389	1	0.26%
name: Verify Parent-child pipelines independent relationship parent pipelines passes if child passes file: parent_child_pipelines_independent_relationship_spec.rb	389	1	0.26%
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results file: pipelines_for_merged_results_and_merge_trains_spec.rb	390	1	0.26%
name: Verify Run pipeline with web only rule can trigger pipeline file: run_pipeline_via_web_only_spec.rb	388	1	0.26%