Reliable e2e test report
- Candidates for promotion to reliable (2023-09-18 - 2023-10-02)
- Reliable specs with failures (2023-09-18 - 2023-10-02)
Candidates for promotion to reliable (2023-09-18 - 2023-10-02)
Total amount: 247
STAGE | COUNT |
---|---|
analytics | 2 |
create | 81 |
data_stores | 23 |
fulfillment | 2 |
govern | 24 |
manage | 17 |
monitor | 3 |
package | 28 |
plan | 22 |
release | 5 |
secure | 1 |
verify | 39 |
analytics (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Analytics Service ping default enabled when using default enabled from gitlab.yml config has service ping toggle enabled file: service_ping_default_enabled_spec.rb |
22 | 0 | 0% |
name: Analytics Performance bar display when logged in as an admin user shows results for the original request and AJAX requests file: performance_bar_spec.rb |
13 | 0 | 0% |
create (81)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Create API basics raw file access sets no-cache headers as expected file: files_spec.rb |
22 | 0 | 0% |
name: Create API basics user creates a project with a file and deletes them afterwards file: files_spec.rb |
22 | 0 | 0% |
name: Create Add a directory in Web IDE when a directory with the same name already exists throws an error file: add_new_directory_in_web_ide_spec.rb |
22 | 0 | 0% |
name: Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed file: add_new_directory_in_web_ide_spec.rb |
22 | 0 | 0% |
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a personal_snippet file: add_comment_to_snippet_spec.rb |
22 | 0 | 0% |
name: Create Adding comments on snippets behaves like comments on snippets adds, edits, and deletes a comment on a project_snippet file: add_comment_to_snippet_spec.rb |
22 | 0 | 0% |
name: Create Branch Rules Overview adds a new branch rule file: add_new_branch_rule_spec.rb |
22 | 0 | 0% |
name: Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly file: branch_with_unusual_name_spec.rb |
22 | 0 | 0% |
name: Create Codeowners displays owners specified in CODEOWNERS file file: code_owners_spec.rb |
22 | 0 | 0% |
name: Create Codeowners merge request assigns code owners as approvers file: assign_code_owners_spec.rb |
22 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_in_subgroup_spec.rb |
22 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is the subgroup behaves like code owner merge request is approved and merged file: merge_with_code_owner_in_subgroup_spec.rb |
22 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is a user behaves like code owner merge request is approved and merged file: merge_with_code_owner_in_root_group_spec.rb |
22 | 0 | 0% |
name: Create Compare archives of different user projects with the same name and check they're different download archives of each user project then check they are different file: project_archive_compare_spec.rb |
22 | 0 | 0% |
name: Create Create a new merge request creates a merge request with a milestone and label file: create_merge_request_spec.rb |
22 | 0 | 0% |
name: Create Create a new project from a template commits via the api file: commit_to_templated_project_spec.rb |
22 | 0 | 0% |
name: Create Create, Retrieve and Delete branches via API creates, retrieves and deletes branches file: add_list_delete_branches_spec.rb |
22 | 0 | 0% |
name: Create File Locking checks file locked by other user to be disabled file: file_locking_spec.rb |
22 | 0 | 0% |
name: Create File Locking creates a merge request and fails to merge file: file_locking_spec.rb |
22 | 0 | 0% |
name: Create File Locking locks a directory and tries to push as a second user file: file_locking_spec.rb |
22 | 0 | 0% |
name: Create File Locking locks a file and tries to push as a second user file: file_locking_spec.rb |
22 | 0 | 0% |
name: Create File Locking locks a file and unlocks in list file: file_locking_spec.rb |
22 | 0 | 0% |
name: Create File management user deletes a file via the Web file: delete_file_via_web_spec.rb |
22 | 0 | 0% |
name: Create File templates user adds .gitignore via file template Android file: add_file_template_spec.rb |
22 | 0 | 0% |
name: Create File templates user adds .gitlab-ci.yml via file template Julia file: add_file_template_spec.rb |
22 | 0 | 0% |
name: Create File templates user adds Dockerfile via file template Python file: add_file_template_spec.rb |
22 | 0 | 0% |
name: Create File templates user adds LICENSE via file template Mozilla Public License 2.0 file: add_file_template_spec.rb |
22 | 0 | 0% |
name: Create File with unusual name when file name starts with a dash and contains hash, semicolon, colon, and question mark renders repository file tree correctly file: file_with_unusual_name_spec.rb |
22 | 0 | 0% |
name: Create Git clone over HTTP user performs a deep clone file: clone_spec.rb |
22 | 0 | 0% |
name: Create Git clone over HTTP user performs a shallow clone file: clone_spec.rb |
22 | 0 | 0% |
name: Create Group file templates creates file via custom .gitignore file template file: group_file_template_spec.rb |
22 | 0 | 0% |
name: Create Group file templates creates file via custom .gitlab-ci.yml file template file: group_file_template_spec.rb |
22 | 0 | 0% |
name: Create Group file templates creates file via custom Dockerfile file template file: group_file_template_spec.rb |
22 | 0 | 0% |
name: Create Group file templates creates file via custom LICENSE file template file: group_file_template_spec.rb |
22 | 0 | 0% |
name: Create Merge request creation from fork can merge source branch from fork into upstream repository file: merge_merge_request_from_fork_spec.rb |
22 | 0 | 0% |
name: Create Merge request push options sets merge when pipeline succeeds file: push_options_mwps_spec.rb |
22 | 0 | 0% |
name: Create Merge request rebasing user rebases source branch of merge request file: rebase_merge_request_spec.rb |
22 | 0 | 0% |
name: Create Merged merge request can be reverted file: reverting_merge_request_spec.rb |
22 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing personal_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
22 | 0 | 0% |
name: Create Multiple file snippet behaves like adding file to snippet adds second file to an existing project_snippet to make it multi-file file: add_file_to_snippet_spec.rb |
22 | 0 | 0% |
name: Create PostReceive idempotent pushes and creates a single push event three times file: push_postreceive_idempotent_spec.rb |
22 | 0 | 0% |
name: Create Project snippet creation user creates a project snippet file: create_project_snippet_spec.rb |
22 | 0 | 0% |
name: Create Project templates when built-in successfully imports the project using template file: project_templates_spec.rb |
22 | 0 | 0% |
name: Create Project templates when instance level successfully imports the project using template file: project_templates_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits allows an unrestricted push file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts branches by branch name file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts commit by message format file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts committing files with secrets file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts files by name and size file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts removal of tag file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using non signed commits restricts users by email format file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules using signed commits restricts to signed commits file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules with commits restricted by author email to existing GitLab users rejects non-member users file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push Rules with commits restricted to verified emails rejects unverified emails file: push_rules_spec.rb |
22 | 0 | 0% |
name: Create Push over HTTP using Git protocol version 2 user pushes to the repository file: protocol_v2_push_http_spec.rb |
22 | 0 | 0% |
name: Create Push over SSH using Git protocol version 2 user pushes to the repository file: protocol_v2_push_ssh_spec.rb |
22 | 0 | 0% |
name: Create Repository License Detection on a project with a commonly used LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb |
22 | 0 | 0% |
name: Create Repository License Detection on a project with an unrecognized LICENSE behaves like project license detection displays the name of the license on the repository file: license_detection_spec.rb |
22 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one group is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like selected developer user pushes and merges file: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
name: Create Restricted protected branch push and merge when only one user is allowed to merge and push to a protected branch behaves like unselected maintainer user fails to push file: restrict_push_protected_branch_spec.rb |
22 | 0 | 0% |
name: Create Setup an MR with codeowners file creates a merge request with codeowners file and squashing commits enabled file: code_owners_with_protected_branch_and_squashed_commits_spec.rb |
22 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
22 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of personal_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
22 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_multiple_files including file number file: snippet_index_page_spec.rb |
22 | 0 | 0% |
name: Create Snippet index page behaves like displaying details on index page shows correct details of project_snippet_with_single_file including file number file: snippet_index_page_spec.rb |
22 | 0 | 0% |
name: Create Source editor toolbar preview can preview markdown side-by-side while editing file: source_editor_toolbar_spec.rb |
22 | 0 | 0% |
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over HTTP, edits via UI file: clone_push_pull_personal_snippet_spec.rb |
22 | 0 | 0% |
name: Create Version control for personal snippets clones, pushes, and pulls a snippet over SSH, deletes via UI file: clone_push_pull_personal_snippet_spec.rb |
22 | 0 | 0% |
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over HTTP, edits via UI file: clone_push_pull_project_snippet_spec.rb |
22 | 0 | 0% |
name: Create Version control for project snippets clones, pushes, and pulls a project snippet over SSH, deletes via UI file: clone_push_pull_project_snippet_spec.rb |
22 | 0 | 0% |
name: Create Codeowners when the project is in a subgroup and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_in_subgroup_spec.rb |
13 | 0 | 0% |
name: Create Codeowners when the project is in the root group and the code owner is the root group behaves like code owner merge request is approved and merged file: merge_with_code_owner_in_root_group_spec.rb |
13 | 0 | 0% |
name: Create Default branch name instance setting allows a project to be created via the CLI with a different default branch name file: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
name: Create Default branch name instance setting sets the default branch name for a new project file: default_branch_name_setting_spec.rb |
13 | 0 | 0% |
name: Create Prereceive hook when creating a tag for a ref when it triggers a prereceive hook configured with a custom error returns a custom server hook error file: tag_revision_trigger_prereceive_hook_spec.rb |
13 | 0 | 0% |
name: Create Pull mirror a repository over SSH with a private key configures and syncs a (pull) mirrored repository file: pull_mirroring_over_ssh_with_key_spec.rb |
13 | 0 | 0% |
name: Create Repository Usage Quota matches cloned repo usage to reported usage file: storage_size_spec.rb |
13 | 0 | 0% |
name: Create push after setting the file size limit via admin/application_settings push fails when the file size is above the limit file: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
name: Create push after setting the file size limit via admin/application_settings push successful when the file size is under the limit file: push_over_http_file_size_spec.rb |
13 | 0 | 0% |
data_stores (23)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Data Stores When using elasticsearch API to search for a known blob searches public project and finds a blob as an non-member user file: nightly_elasticsearch_test_spec.rb |
113 | 0 | 0% |
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project description file: advanced_global_advanced_syntax_search_spec.rb |
61 | 0 | 0% |
name: Data Stores Elasticsearch advanced global search with advanced syntax when searching for projects using advanced syntax searches in the project name file: advanced_global_advanced_syntax_search_spec.rb |
61 | 0 | 0% |
name: Data Stores When using Advanced Search API to search for a public commit finds commit that matches commit message file: commit_index_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository does not find a blob as an non-member user file: elasticsearch_api_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a known blob When searching a private repository finds a blob as an authorized user file: elasticsearch_api_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public blob finds blob that matches file content file: blob_index_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public issue finds issue that matches description file: issue_index_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public merge request finds merge request that matches description file: merge_request_index_spec.rb |
61 | 0 | 0% |
name: Data Stores When using elasticsearch API to search for a public note finds note that matches note body file: note_index_spec.rb |
61 | 0 | 0% |
name: Data Stores When using advanced search API to search for a user finds the user that matches username file: user_index_spec.rb |
52 | 0 | 0% |
name: Data Stores User when added to parent group is allowed to commit to sub-group project via the API file: user_inherited_access_spec.rb |
22 | 0 | 0% |
name: Data Stores User when added to sub-group is not allowed to create a file in parent group project via the API file: user_inherited_access_spec.rb |
22 | 0 | 0% |
name: Data Stores Group member access request generates a todo item for the group owner file: group_member_access_request_spec.rb |
13 | 0 | 0% |
name: Data Stores Group member access request when managing requests as the group owner and request is accepted adds user to the group file: group_member_access_request_spec.rb |
13 | 0 | 0% |
name: Data Stores Group member access request when managing requests as the group owner and request is denied does not add user to the group file: group_member_access_request_spec.rb |
13 | 0 | 0% |
name: Data Stores Group with members can be shared with another group with correct access level file: share_group_with_group_spec.rb |
13 | 0 | 0% |
name: Data Stores Subgroup transfer transfers a subgroup to another group file: transfer_group_spec.rb |
13 | 0 | 0% |
name: Data Stores User can be followed and their activity seen file: follow_user_activity_spec.rb |
13 | 0 | 0% |
name: Data Stores User when added to parent group is allowed to edit the sub-group project files file: user_inherited_access_spec.rb |
13 | 0 | 0% |
name: Data Stores User when added to sub-group is not allowed to edit the parent group project files file: user_inherited_access_spec.rb |
13 | 0 | 0% |
name: Data Stores prevent forking outside group when disabled allows forking outside of group file: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
name: Data Stores prevent forking outside group when enabled does not allow forking outside of group file: prevent_forking_outside_group_spec.rb |
13 | 0 | 0% |
fulfillment (2)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Fulfillment Active license details shows up in subscription page file: license_spec.rb |
13 | 0 | 0% |
name: Fulfillment Purchase User Registration when adding and removing a group member consumes a seat on the license file: user_registration_billing_spec.rb |
13 | 0 | 0% |
govern (24)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Govern Compliance pipeline when a compliance framework has a compliance pipeline runs that pipeline in a different project that has the compliance framework assigned file: compliance_pipeline_spec.rb |
22 | 0 | 0% |
name: Govern Group for change repository size limit behaves like audit event logs audit events for UI operations file: group_audit_logs_1_spec.rb |
22 | 0 | 0% |
name: Govern Scan result policy does not block merge when scan result policy does not apply for pipeline security findings file: scan_result_policy_vulnerabilities_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports dependency list has empty state file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports displays false positives for the vulnerabilities file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports displays security reports in the group security dashboard file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports displays security reports in the pipeline file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports displays security reports in the project security dashboard file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Security Reports for dependency scanning displays the Dependency List file: security_reports_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability Report Security Training does not show security training section in vulnerability details when the setting is turned OFF file: vulnerability_security_training_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability Report Security Training shows security training section for supported vulnerabilities when the setting is toggled ON file: vulnerability_security_training_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability management in a merge request can create an auto-remediation MR from mr security widget file: vulnerability_management_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability management in a merge request can create an issue from a vulnerability from mr security widget file: vulnerability_management_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability management in a merge request can dismiss a vulnerability with a reason from mr security widget file: vulnerability_management_spec.rb |
22 | 0 | 0% |
name: Govern Vulnerability management in a merge request can create an issue from a security finding in pipeline security tab file: vulnerability_management_spec.rb |
19 | 0 | 0% |
name: Govern Group audit event streaming with a destination configured when a group is created the external server receives the event file: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Group audit event streaming with a destination configured when a project is shared with a group the external server receives the event file: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Group audit event streaming with a destination configured when a user is added to a group the external server receives the event file: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Group audit event streaming with no destination adds a streaming destination file: group_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Instance audit event streaming when a group is created the external server receives the event file: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Instance audit event streaming when a project is created the external server receives the event file: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Instance audit event streaming when a repository is cloned via SSH the external server receives the event file: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Instance audit event streaming when a user is created the external server receives the event file: instance_audit_event_streaming_spec.rb |
13 | 0 | 0% |
name: Govern Vulnerability report in a project can export vulnerability report to csv file: export_vulnerability_report_spec.rb |
13 | 0 | 0% |
manage (17)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage 2FA allows enforcing 2FA via UI and logging in with 2FA file: log_in_with_2fa_spec.rb |
22 | 0 | 0% |
name: Manage Group access token can be used to create a file via the project API file: group_access_token_spec.rb |
22 | 0 | 0% |
name: Manage Group access tokens can be created and revoked via the UI file: group_access_token_spec.rb |
22 | 0 | 0% |
name: Manage Impersonation tokens can be created and revoked via the UI file: impersonation_token_spec.rb |
22 | 0 | 0% |
name: Manage Project access token for a different project cannot be used to commit via the API file: project_access_token_spec.rb |
22 | 0 | 0% |
name: Manage Project access token for a different project cannot be used to create a file via the project API file: project_access_token_spec.rb |
22 | 0 | 0% |
name: Manage Project access token for the same project can be used to commit via the API file: project_access_token_spec.rb |
22 | 0 | 0% |
name: Manage Project access token for the same project can be used to create a file via the project API file: project_access_token_spec.rb |
22 | 0 | 0% |
name: Manage User when parent group membership is terminated is not allowed to commit via the API file: user_access_termination_spec.rb |
22 | 0 | 0% |
name: Manage User when parent group membership is terminated is not allowed to create a file via the API file: user_access_termination_spec.rb |
22 | 0 | 0% |
name: Manage User when parent group membership is terminated is not allowed to push code via the CLI file: user_access_termination_spec.rb |
22 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to commit via the API file: minimal_access_user_spec.rb |
22 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to create a file via the API file: minimal_access_user_spec.rb |
22 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to edit files via the UI file: minimal_access_user_spec.rb |
22 | 0 | 0% |
name: Manage User with minimal access to group is not allowed to push code via the CLI file: minimal_access_user_spec.rb |
22 | 0 | 0% |
name: Manage Gitlab migration with import within same instance successfully imports project file: gitlab_migration_project_spec.rb |
13 | 0 | 0% |
name: Manage Jenkins integration integrates and displays build status for MR pipeline in GitLab file: jenkins_build_status_spec.rb |
13 | 0 | 0% |
monitor (3)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Monitor Alert when using HTTP endpoint integration behaves like new alert automatically creates new incident file: automatically_creates_incident_for_alert_spec.rb |
22 | 0 | 0% |
name: Monitor Alert when using Prometheus integration behaves like new alert automatically creates new incident file: automatically_creates_incident_for_alert_spec.rb |
22 | 0 | 0% |
name: Monitor Recovery alert when using Prometheus integration behaves like triggers recovery alert only resolves the correct alert file: recovery_alert_resolves_correct_alert_spec.rb |
22 | 0 | 0% |
package (28)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Package Conan Repository publishes, installs, and deletes a Conan package file: conan_repository_spec.rb |
22 | 0 | 0% |
name: Package Generic Repository uploads a generic package and downloads it file: generic_repository_spec.rb |
22 | 0 | 0% |
name: Package Helm Registry using ci job token pushes and pulls a helm chart file: helm_registry_spec.rb |
22 | 0 | 0% |
name: Package Helm Registry using personal access token pushes and pulls a helm chart file: helm_registry_spec.rb |
22 | 0 | 0% |
name: Package Helm Registry using project deploy token pushes and pulls a helm chart file: helm_registry_spec.rb |
22 | 0 | 0% |
name: Package Maven Repository with Gradle using ci job token pushes and pulls a maven package via gradle file: maven_gradle_repository_spec.rb |
22 | 0 | 0% |
name: Package Maven Repository with Gradle using personal access token pushes and pulls a maven package via gradle file: maven_gradle_repository_spec.rb |
22 | 0 | 0% |
name: Package Maven group level endpoint duplication setting when disabled prevents users from publishing duplicates file: maven_group_level_spec.rb |
22 | 0 | 0% |
name: Package Maven group level endpoint via maven using a ci job token pushes and pulls a maven package file: maven_group_level_spec.rb |
22 | 0 | 0% |
name: Package Maven group level endpoint via maven using a personal access token pushes and pulls a maven package file: maven_group_level_spec.rb |
22 | 0 | 0% |
name: Package Maven project level endpoint using a ci job token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
22 | 0 | 0% |
name: Package Maven project level endpoint using a personal access token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
22 | 0 | 0% |
name: Package Maven project level endpoint using a project deploy token pushes and pulls a maven package via maven file: maven_project_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet group level endpoint using ci job token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet group level endpoint using group deploy token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet group level endpoint using personal access token publishes a nuget package at the project endpoint and installs it from the group endpoint file: nuget_group_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet project level endpoint using a ci job token publishes a nuget package and installs file: nuget_project_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet project level endpoint using a personal access token publishes a nuget package and installs file: nuget_project_level_spec.rb |
22 | 0 | 0% |
name: Package NuGet project level endpoint using a project deploy token publishes a nuget package and installs file: nuget_project_level_spec.rb |
22 | 0 | 0% |
name: Package PyPI Repository when at the project level publishes and installs a pypi package file: pypi_repository_spec.rb |
22 | 0 | 0% |
name: Package RubyGems Repository publishes a Ruby gem file: rubygems_registry_spec.rb |
22 | 0 | 0% |
name: Package Terraform Module Registry publishes a module file: terraform_module_registry_spec.rb |
22 | 0 | 0% |
name: Package npm Registry group level endpoint using personal access token push and pull a npm package via CI file: npm_group_level_spec.rb |
22 | 0 | 0% |
name: Package npm Registry group level endpoint using project deploy token push and pull a npm package via CI file: npm_group_level_spec.rb |
22 | 0 | 0% |
name: Package npm Registry instance level endpoint using ci job token push and pull a npm package via CI file: npm_instance_level_spec.rb |
22 | 0 | 0% |
name: Package npm Registry instance level endpoint using personal access token push and pull a npm package via CI file: npm_instance_level_spec.rb |
22 | 0 | 0% |
name: Package npm Registry project level endpoint using ci job token push and pull a npm package via CI file: npm_project_level_spec.rb |
22 | 0 | 0% |
name: Package npm Registry project level endpoint using project deploy token push and pull a npm package via CI file: npm_project_level_spec.rb |
22 | 0 | 0% |
plan (22)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan A project wiki can change the directory path of a page file: project_based_directory_management_spec.rb |
22 | 0 | 0% |
name: Plan Assign Iterations assigns a group iteration to an existing issue file: assign_group_iteration_spec.rb |
22 | 0 | 0% |
name: Plan Assignees update without refresh file: real_time_assignee_spec.rb |
22 | 0 | 0% |
name: Plan Creating pages in group wikis when wiki has a home page adds a second page file: create_group_wiki_page_spec.rb |
22 | 0 | 0% |
name: Plan Creating pages in group wikis when wiki is empty creates a new page file: create_group_wiki_page_spec.rb |
22 | 0 | 0% |
name: Plan Design Management user adds a design and annotates it file: add_design_content_spec.rb |
22 | 0 | 0% |
name: Plan Design Management user adds a design and modifies it file: modify_design_content_spec.rb |
22 | 0 | 0% |
name: Plan Design Management user archives a design file: archive_design_content_spec.rb |
22 | 0 | 0% |
name: Plan Editing scoped labels on issues correctly applies simple and multiple colon scoped pairs labels file: editing_scoped_labels_spec.rb |
22 | 0 | 0% |
name: Plan Epics milestone dates API updates epic dates when updating milestones file: epics_milestone_dates_spec.rb |
22 | 0 | 0% |
name: Plan Group Iterations creates a group iteration automatically through an iteration cadence file: create_group_iteration_spec.rb |
22 | 0 | 0% |
name: Plan Issue closes via pushing a commit file: closes_issue_via_pushing_a_commit_spec.rb |
22 | 0 | 0% |
name: Plan Project Wiki with Wiki Page List has all expected links that work file: project_based_list_spec.rb |
22 | 0 | 0% |
name: Plan Project Wiki with Wiki Sidebar has all expected links that work file: project_based_list_spec.rb |
22 | 0 | 0% |
name: Plan Testing group wiki can delete a group wiki page file: delete_group_wiki_page_spec.rb |
22 | 0 | 0% |
name: Plan Testing project wiki can delete a page file: project_based_page_deletion_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki file: project_based_content_creation_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content creation inside a project by adding a home page to the wiki using git push file: project_based_content_creation_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki file: project_based_content_creation_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content creation inside a project by adding a second page to the wiki using git push file: project_based_content_creation_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page file: project_based_content_manipulation_spec.rb |
22 | 0 | 0% |
name: Plan Testing wiki content manipulation inside a project by manipulating content on the page using git push file: project_based_content_manipulation_spec.rb |
22 | 0 | 0% |
release (5)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Release Deploy key creation user adds a deploy key file: add_deploy_key_spec.rb |
22 | 0 | 0% |
name: Release Deploy token creation user adds a deploy token file: add_deploy_token_spec.rb |
22 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
name: Release Git clone using a deploy key user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines file: clone_using_deploy_key_spec.rb |
22 | 0 | 0% |
secure (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Secure Enable Scanning from UI enable dependency scanning from configuration runs dependency scanning job when enabled from configuration file: enable_scanning_from_configuration_spec.rb |
22 | 0 | 0% |
verify (39)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Endpoint Coverage spans r/w postgres web sidekiq git api file: endpoint_coverage_spec.rb |
22 | 0 | 0% |
name: Verify Group runner registration user registers a new group runner file: register_group_runner_spec.rb |
22 | 0 | 0% |
name: Verify Include multiple files from a project runs the pipeline with composed config file: include_multiple_files_from_a_project_spec.rb |
22 | 0 | 0% |
name: Verify Include multiple files from multiple projects runs the pipeline with composed config file: include_multiple_files_from_multiple_projects_spec.rb |
22 | 0 | 0% |
name: Verify Multi-project pipelines creates a multi-project pipeline with artifact download file: multi-project_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Pass dotenv variables to downstream via bridge runs the pipeline with composed config file: pass_dotenv_variables_to_downstream_via_bridge_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline API defined variable inheritance is determined based on forward:pipeline_variables condition file: api_variable_inheritance_with_forward_pipeline_variables_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline subscription with a group owned project when upstream project new tag pipeline finishes triggers pipeline in downstream project file: pipeline_subscription_with_group_owned_project_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with customizable variable manually creates a pipeline and uses the defined custom variable value file: custom_variable_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is allowed with [always if-not-present] policies applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is allowed with [always] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is allowed with [if-not-present] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is allowed with [never] policy applies pull policy in job correctly file: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with image:pull_policy when policy is not allowed fails job with policy not allowed message file: pipeline_with_image_pull_policy_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with prefill variables shows dropdown for variables with description, value, and options defined file: prefill_variables_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with prefill variables shows only variables with description as prefill variables on the run pipeline page file: prefill_variables_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with project file variables can read file variable content with cat file: file_variable_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with project file variables does not expose file variable content with echo file: file_variable_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with protected variable does not expose variable on unprotected branch file: pipeline_with_protected_variable_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with protected variable exposes variable on protected branch file: pipeline_with_protected_variable_spec.rb |
22 | 0 | 0% |
name: Verify Pipeline with raw variables in YAML expands variables according to expand: true/false file: raw_variables_defined_in_yaml_spec.rb |
22 | 0 | 0% |
name: Verify Run pipeline with manual jobs does not leave any job in skipped state file: run_pipeline_with_manual_jobs_spec.rb |
22 | 0 | 0% |
name: Verify Runner fleet management shows group runner counts file: group_runner_counts_spec.rb |
22 | 0 | 0% |
name: Verify Runner fleet management shows group runner online count file: group_runner_status_counts_spec.rb |
22 | 0 | 0% |
name: Verify Runner registration user registers a new project runner file: register_runner_spec.rb |
22 | 0 | 0% |
name: Verify Trigger child pipeline with 'when:manual' can trigger bridge job file: trigger_child_pipeline_with_manual_spec.rb |
22 | 0 | 0% |
name: Verify Trigger matrix creates 2 trigger jobs and passes corresponding matrix variables file: trigger_matrix_spec.rb |
22 | 0 | 0% |
name: Verify UI defined variable is inheritable when forward:pipeline_variables is true file: ui_variable_inheritable_when_forward_pipeline_variables_true_spec.rb |
22 | 0 | 0% |
name: Verify UI defined variable is not inheritable by default file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
22 | 0 | 0% |
name: Verify UI defined variable is not inheritable when forward:pipeline_variables is false file: ui_variable_non_inheritable_when_forward_pipeline_variables_false_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family file: unlocking_job_artifacts_across_parent_child_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Unlocking job artifacts across pipelines when latest pipeline is successful unlocks job artifacts from previous successful pipeline file: unlocking_job_artifacts_across_pipelines_spec.rb |
22 | 0 | 0% |
name: Verify Update CI file with pipeline editor creates new pipelines, target branch, and merge request file: update_ci_file_with_pipeline_editor_spec.rb |
22 | 0 | 0% |
name: Verify When user is blocked pipeline schedule is canceled file: cancel_pipeline_when_block_user_spec.rb |
22 | 0 | 0% |
Reliable specs with failures (2023-09-18 - 2023-10-02)
Total amount: 56
STAGE | COUNT |
---|---|
create | 16 |
data_stores | 6 |
govern | 9 |
manage | 1 |
plan | 17 |
verify | 7 |
create (16)
Executions table
data_stores (6)
Executions table
govern (9)
Executions table
manage (1)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Manage Project access tokens can be created and revoked via the UI file: project_access_token_spec.rb Exceptions: - Waiting for QA::Resource::Project to be removed failed after 60 seconds
|
354 | 2 | 0.56% |
plan (17)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Plan Merge Request Analytics shows merge request analytics chart and stats file: mr_analytics_spec.rb Exceptions: - Fabrication of QA::Resource::Group using the API failed (500) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1" name="viewport"> <title>Something went wrong (500)</title> <style> body { color: #666; ... - navbar did not appear on QA::Page::Main::Menu as expected - Timed out waiting for merge of MR with id '2'. Final status was 'checking'
|
237 | 3 | 1.27% |
name: Plan Group issue boards creates a group issue board via the GUI file: create_group_issue_board_spec.rb Exceptions: - Group with name qa-test-2023-09-19-18-36-20-30a04c1081718cbd not found! - Group with name qa-test-2023-09-20-01-43-22-6675134cd1f2f90b not found! - Group with name qa-test-2023-09-20-04-43-02-82e9792422056043 not found! - Group with name qa-test-2023-09-22-15-38-53-ea77b545d3ef9f23 not found!
|
354 | 4 | 1.13% |
name: Plan Group issue boards shows multiple group boards in the boards dropdown menu file: group_issue_boards_spec.rb Exceptions: - Group with name qa-test-2023-09-19-16-21-01-28dff01699d8ceb9 not found! - Group with name qa-test-2023-09-19-18-36-10-21a58ff020ca18d9 not found! - Group with name qa-test-2023-09-20-01-42-48-eefbb6fccf139997 not found! - Group with name qa-test-2023-09-20-04-43-25-c1388fafc2c74f41 not found!
|
353 | 4 | 1.13% |
name: Plan Testing project wiki file upload by creating a formatted page with an image uploaded file: project_based_file_upload_spec.rb Exceptions: - Waiting for QA::Resource::Project to be removed failed after 60 seconds
|
341 | 3 | 0.88% |
name: Plan Related issues relates and unrelates one issue to/from another file: related_issues_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError - Unable to find css "[data-testid=\"add_issue_field\"],[data-qa-selector=\"add_issue_field\"]"
|
354 | 2 | 0.56% |
name: Plan Value stream analytics without pre-existing dashboard with custom template behaves like value stream analytics shows vsa dashboard file: value_stream_analytics_spec.rb Exceptions: - Fabrication of QA::Resource::User using the API failed (500) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1" name="viewport"> <title>Something went wrong (500)</title> <style> body { color: #666; ...
|
237 | 1 | 0.42% |
name: Plan Value stream analytics without pre-existing dashboard with default template behaves like value stream analytics shows vsa dashboard file: value_stream_analytics_spec.rb Exceptions: - navbar did not appear on QA::Page::Main::Menu as expected
|
237 | 1 | 0.42% |
name: Plan Configurable issue board renames the issue board file: configurable_issue_board_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
354 | 1 | 0.28% |
name: Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic file: epics_management_spec.rb Exceptions: - Unable to find css "[data-testid=\"epic_issue_actions_split_button\"],[data-qa-selector=\"epic_issue_actions_split_button\"]"
|
354 | 1 | 0.28% |
name: Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions file: epics_management_spec.rb Exceptions: - expected QA::EE::Page::Group::Epic::Show to have system note "added issue"
|
354 | 1 | 0.28% |
name: Plan Group milestone creates a group milestone file: create_group_milestone_spec.rb Exceptions: - Unable to find css "[data-testid=\"new_group_milestone_link\"],[data-qa-selector=\"new_group_milestone_link\"]"
|
354 | 1 | 0.28% |
name: Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page file: issue_weight_visualization_spec.rb Exceptions: - Unable to find css "[data-testid=\"milestone_link\"],[data-qa-selector=\"milestone_link\"]"
|
354 | 1 | 0.28% |
name: Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page file: more_than_four_assignees_spec.rb Exceptions: - Unable to find css "[data-testid=\"assignee_block_container\"],[data-qa-selector=\"assignee_block_container\"]"
|
354 | 1 | 0.28% |
name: Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it file: project_issue_boards_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError
|
354 | 1 | 0.28% |
name: Plan Project milestone creates a project milestone file: create_project_milestone_spec.rb Exceptions: - Unable to find css "[data-testid=\"new_project_milestone_link\"],[data-qa-selector=\"new_project_milestone_link\"]"
|
354 | 1 | 0.28% |
name: Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header file: sum_of_issues_weights_spec.rb Exceptions: - Fabrication of QA::Resource::Issue using the API failed (500) with '<!DOCTYPE html><html><head> <meta content="width=device-width, initial-scale=1" name="viewport"> <title>Something went wrong (500)</title> <style> body { color: #666; ...
|
353 | 1 | 0.28% |
name: Plan issue suggestions shows issue suggestions when creating a new issue file: issue_suggestions_spec.rb Exceptions: - Fabrication of QA::Resource::Project using the API failed (400) with '{"message":{"base":["PG::UndefinedTable: ERROR: relation \"namespaces\" does not exist\nLINE 1: ...,db_config_name:main*/ SELECT \"namespaces\".* FROM \"namespace...\n ...
|
354 | 1 | 0.28% |
verify (7)
Executions table
NAME | RUNS | FAILURES | FAILURE RATE |
---|---|---|---|
name: Verify Parent-child pipelines independent relationship parent pipelines passes if child passes file: parent_child_pipelines_independent_relationship_spec.rb Exceptions: - Wait failed after 60 seconds:expected to eventually be_truthy: []last attempt was: nilDiff:
|
353 | 2 | 0.57% |
name: Verify Include local config file paths with wildcard runs the pipeline with composed config file: include_local_config_file_paths_with_wildcard_spec.rb Exceptions: - Waiting for QA::Resource::Project to be removed failed after 60 seconds
|
354 | 2 | 0.56% |
name: Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes file: parent_child_pipelines_dependent_relationship_spec.rb Exceptions: - Wait for runner 'pipelines-dependent-relationship-5d70be320cfc26f4' to register in project 'pipelines-dependent-relationship-5d70be320cfc26f4' failed after 60 seconds - Waiting for linked pipeline to appear failed after 3 attempts
|
354 | 2 | 0.56% |
name: Verify Pipelines for merged results and merge trains merges via a merge train file: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - RSpec::Core::MultipleExceptionError - Wait failed after 120 seconds
|
354 | 2 | 0.56% |
name: Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails file: parent_child_pipelines_dependent_relationship_spec.rb Exceptions: - Waiting for linked pipeline to appear failed after 3 attempts
|
354 | 1 | 0.28% |
name: Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails file: parent_child_pipelines_independent_relationship_spec.rb Exceptions: - Wait failed after 60 seconds:expected to eventually be_truthy: []last attempt was: nilDiff:
|
353 | 1 | 0.28% |
name: Verify Pipelines for merged results and merge trains creates a pipeline with merged results file: pipelines_for_merged_results_and_merge_trains_spec.rb Exceptions: - Wait failed after 120 seconds
|
354 | 1 | 0.28% |