qa:metadata-lint

Passed Started 1 year ago by
1Running with gitlab-runner 15.9.0~beta.212.g8ccc65e7 (8ccc65e7)
2  on green-3.private.runners-manager.gitlab.com/gitlab.com/gitlab-org QuQPoFsC, system ID: s_fc023362bf2f
3  feature flags: FF_NETWORK_PER_BUILD:true, FF_USE_FASTZIP:true, FF_USE_IMPROVED_URL_MASKING:true
 4  Resolving secrets  
  00:00
 5  Preparing the "docker+machine" executor  
  00:04
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
7Authenticating with credentials from job payload (GitLab Registry)
8Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 ...
9Using docker image sha256:7235367e03bd134ea3589fd68c26d1f1d2ae8341a82a8416dadbd044497eab14 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12@sha256:6924f23f31f975e6b3b78f798461c0b8f2157c11d8761e2614295601ced33783 ...
 10  Preparing environment  
  00:01
11Running on runner-quqpofsc-project-278964-concurrent-0 via runner-quqpofsc-private-1680006212-2739c044...
 12  Getting source from Git repository  
  00:35
13$ eval "$CI_PRE_CLONE_SCRIPT"
14Fetching changes with git depth set to 20...
15Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
16Created fresh repository.
17remote: Enumerating objects: 168536, done.        
18remote: Counting objects: 100% (168536/168536), done.        
19remote: Compressing objects: 100% (107987/107987), done.        
20remote: Total 168536 (delta 80367), reused 116592 (delta 54049), pack-reused 0        
21Receiving objects: 100% (168536/168536), 132.70 MiB | 22.96 MiB/s, done.
22Resolving deltas: 100% (80367/80367), done.
23From https://git-us-east1-c.ci-gateway.int.gprd.gitlab.net:8989/gitlab-org/gitlab
24 * [new ref]             refs/pipelines/820503977 -> refs/pipelines/820503977
25Checking out da011c02 as detached HEAD (ref is refs/merge-requests/116002/merge)...
26Skipping Git submodules setup
27$ git remote set-url origin "${CI_REPOSITORY_URL}"
 28  Executing "step_script" stage of the job script  
  00:40
29Using docker image sha256:7235367e03bd134ea3589fd68c26d1f1d2ae8341a82a8416dadbd044497eab14 for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12:rubygems-3.4-git-2.36-lfs-2.9-chrome-109-yarn-1.22-graphicsmagick-1.3.36 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0.patched-golang-1.18-rust-1.65-node-16.14-postgresql-12@sha256:6924f23f31f975e6b3b78f798461c0b8f2157c11d8761e2614295601ced33783 ...
30$ echo $FOSS_ONLY
31$ [ "$FOSS_ONLY" = "1" ] && rm -rf ee/ qa/spec/ee/ qa/qa/specs/features/ee/ qa/qa/ee/ qa/qa/ee.rb
32$ export GOPATH=$CI_PROJECT_DIR/.go
33$ mkdir -p $GOPATH
34$ source scripts/utils.sh
35$ source scripts/prepare_build.sh
36Using decomposed database config (config/database.yml.decomposed-postgresql)
37Geo DB won't be set up.
38$ cd qa/
39$ bundle_install_script
 40  Installing gems  
  00:32
334$ run_timed_command "bundle exec bin/qa Test::Instance::All http://localhost:3000 --test-metadata-only"
335$ bundle exec bin/qa Test::Instance::All http://localhost:3000 --test-metadata-only
3362023-03-28 14:58:02 WARN Selenium [:logger_info] Details on how to use and modify Selenium logger:
337  https://selenium.dev/documentation/webdriver/troubleshooting/logging#ruby
3382023-03-28 14:58:02 WARN Selenium [DEPRECATION] [:caps_browsers] Remote::Capabilities.chrome is deprecated. Use Options.chrome instead.
3392023-03-28 14:58:02 WARN Selenium [DEPRECATION] [:capabilities] The :capabilities parameter for Selenium::WebDriver::Chrome::Driver is deprecated. Use :options argument with an instance of Selenium::WebDriver::Chrome::Driver instead.
3402023-03-28 14:58:04 / CONF	:: 
341      ==> Base URL: http://localhost:3000
342      ==> Browser: #<Selenium::WebDriver::Chrome::Driver:0x00007fe4e417a9a0>
343      ==> Libraries: Chemlab::Vendor
344Randomized with seed 29759
345Verify
346  Pipeline with prefill variables
347    shows only variables with description as prefill variables on the run pipeline page
348    shows dropdown for variables with description, value, and options defined
349Systems
350  Maven package
351    replicates to the secondary site
352Plan
353  Burndown chart
354    shows burndown chart on milestone page
355Package
356  Conan Repository
357    publishes, installs, and deletes a Conan package
358Create
359  Git clone over HTTP
360    user performs a shallow clone
361    user performs a deep clone
362Govern
363  Scan result policy
364    requires approval when a pipeline report has findings matching the scan result policy
365Create
366  Testing wiki content manipulation inside a project
367    by manipulating content on the page using git push
368    by manipulating content on the page
369Configure
370  Mattermost support
371    user creates a group with a mattermost team
372Plan
373  Contribution Analytics
374    tests contributions
375Create
376  Testing project wiki
377    can delete a page
378Monitor
379  Recovery alert
380    when using HTTP endpoint integration
381      behaves like triggers recovery alert
382        only resolves the correct alert
383    when using Prometheus integration
384      behaves like triggers recovery alert
385        only resolves the correct alert
386Create
387  Default merge request templates
388    uses default template when creating a merge request
389Create
390  File templates
391    user adds .gitlab-ci.yml via file template Julia
392    user adds LICENSE via file template Mozilla Public License 2.0
393    user adds Dockerfile via file template Python
394    user adds .gitignore via file template Android
395Plan
396  Group milestone
397    creates a group milestone
398Systems
399  Gitaly backend node recovery
400    recovers from dataloss
401Verify
402  Include multiple files from multiple projects
403    when FF is on
404      runs the pipeline with composed config
405    when FF is off
406      runs the pipeline with composed config
407Data Stores
408  When using elasticsearch API to search for a public blob
409    finds blob that matches file content
410Package
411  Container Registry Online Garbage Collection
412    runs the online garbage collector tool
413Create
414  Push over SSH using Git protocol version 2
415    user pushes to the repository
416Create
417  Restricted protected branch push and merge
418    when only one user is allowed to merge and push to a protected branch
419      behaves like unselected maintainer
420        user fails to push
421      behaves like selected developer
422        user pushes and merges
423    when only one group is allowed to merge and push to a protected branch
424      behaves like unselected maintainer
425        user fails to push
426      behaves like selected developer
427        user pushes and merges
428Manage
429  Gitlab migration
430    with import within same instance
431      successfully imports project
432    with wiki
433      successfully imports project wiki
434    with repository
435      successfully imports repository
436    with uninitialized project
437      successfully imports project
438Create
439  Group file templates
440    creates file via custom LICENSE file template
441    creates file via custom Dockerfile file template
442    creates file via custom .gitignore file template
443    creates file via custom .gitlab-ci.yml file template
444Create
445  Merge request push options
446    sets title and description
447Systems
448  GitLab HTTP push
449    when regular git commit
450      is replicated to the secondary
451    when git-lfs commit
452      is replicated to the secondary
453Release
454  Operations Dashboard
455    has many pipelines with appropriate statuses
456Plan
457  promote issue to epic
458    promotes issue to epic
459Systems
460  with Gitaly automatic failover and recovery
461    automatically fails over
462    when recovering from dataloss after failover
463      automatically reconciles
464Manage
465  Jenkins integration
466    integrates and displays build status for MR pipeline in GitLab
467Systems
468  GitLab SSH push to secondary
469    when regular git commit
470      is proxied to the primary and ultimately replicated to the secondary
471    when git-lfs commit
472      is proxied to the primary and ultimately replicated to the secondary
473Fulfillment
474  Active license details
475    shows up in subscription page
476Create
477  Codeowners
478    when the project is in the root group
479      and the code owner is the root group
480        behaves like code owner merge request
481          is approved and merged
482      and the code owner is a user
483        behaves like code owner merge request
484          is approved and merged
485Manage
486  Jira issue import
487    imports issues from Jira
488Plan
489  Design Management
490    user adds a design and annotates it
491Govern
492  Project
493    for add deploy key
494      behaves like audit event
495        logs audit events for UI operations
496    for project archive and unarchive
497      behaves like audit event
498        logs audit events for UI operations
499    for change visibility
500      behaves like audit event
501        logs audit events for UI operations
502    for export file download
503      behaves like audit event
504        logs audit events for UI operations
505    for add project
506      behaves like audit event
507        logs audit events for UI operations
508    for add user access as guest
509      behaves like audit event
510        logs audit events for UI operations
511Fulfillment
512  Utilization
513    in usage quotas storage tab for free plan with a project
514      shows correct used up storage for namespace (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/398115)
515Create
516  Link to line in Web IDE
517    can link to a specific line of code in Web IDE
518Verify
519  Parent-child pipelines independent relationship
520    parent pipelines passes if child passes
521    parent pipeline passes even if child fails
522Plan
523  Configure issue board by label
524    shows only issues that match the configured label
525Create
526  Multiple file snippet
527    behaves like deleting file from snippet
528      deletes second file from an existing personal_snippet to make it single-file
529    behaves like deleting file from snippet
530      deletes second file from an existing project_snippet to make it single-file
531Create
532  Project snippet creation
533    user creates a project snippet
534Manage
535  Gitlab migration
536    with release
537      successfully imports project release
538Package
539  Terraform Module Registry
540    publishes a module
541Govern
542  Security Reports in a Merge Request Widget
543    displays vulnerabilities in merge request widget
544Data Stores
545  When using elasticsearch API to search for a public merge request
546    finds merge request that matches description
547Create
548  API basics
549    user creates a project with a file and deletes them afterwards
550    raw file access
551      sets no-cache headers as expected
552Package
553  Container Registry
554    pushes project image to the container registry and deletes tag
555Verify
556  Artifacts
557    when locked
558      can be browsed
559Systems
560  CI job
561    replicates the job artifact to the secondary Geo site
562    replicates the job log to the secondary Geo site
563Verify
564  Include local config file paths with wildcard
565    runs the pipeline with composed config
566Create
567  Create a new merge request
568    creates a merge request with a milestone and label
569    creates a basic merge request
570Govern
571  vulnerability report with jira integration
572    can successfully create a JIRA issue from vulnerability details page
573Verify
574  Update CI file with pipeline editor
575    creates new pipeline and target branch
576Create
577  Pull mirror a repository over HTTP
578    configures and syncs a (pull) mirrored repository with password auth
579Create
580  Multiple file snippet
581    behaves like adding file to snippet
582      adds second file to an existing project_snippet to make it multi-file
583    behaves like adding file to snippet
584      adds second file to an existing personal_snippet to make it multi-file
585Manage
586  Impersonation tokens
587    can be created and revoked via the UI
588Verify
589  Pipeline editor
590    can create merge request
591Create
592  Web IDE file templates
593    user adds Dockerfile via file template Python
594    user adds .gitignore via file template Android
595    user adds LICENSE via file template Mozilla Public License 2.0
596    user adds .gitlab-ci.yml via file template Julia
597Data Stores
598  Elasticsearch advanced global search with advanced syntax
599    when searching for projects using advanced syntax
600      searches in the project name
601      searches in the project description
602Verify
603  Group runner registration
604    user registers a new group runner
605Plan
606  filter issue comments activities
607    filters comments and activities in an issue
608Data Stores
609  Subgroup transfer
610    transfers a subgroup to another group
611Create
612  Merge request push options
613    sets labels
614    when labels are set already
615      removes them on subsequent push
616Data Stores
617  Group with members
618    can be shared with another group with correct access level
619Package
620  RubyGems Repository
621    publishes a Ruby gem
622Create
623  A project wiki
624    can change the directory path of a page
625Plan
626  Group issue boards
627    creates a group issue board via the GUI
628Systems
629  npm registry
630    replicates npm registry to secondary Geo site
631Monitor
632  Alert settings
633    when using Prometheus integration
634      behaves like sends test alert using authorization key
635        creates new alert
636    when using HTTP endpoint integration
637      behaves like sends test alert using authorization key
638        creates new alert
639Plan
640  Editing scoped labels on issues
641    correctly applies simple and multiple colon scoped pairs labels
642Manage
643  Group SAML SSO - Enforced SSO
644    user clones and pushes to project within a group using Git HTTP
645Plan
646  issue suggestions
647    shows issue suggestions when creating a new issue
648Manage
649  Gitlab migration
650    imports group from UI
651Plan
652  Project issue boards
653    Milestone issue board
654      shows the just created board with a "1.0" (milestone) list, and an issue on it
655    Label issue board
656      shows the just created board with a "Testing" (label) list, and an issue on it
657    Assignee issue board
658      shows the just created board with an assignee list, and an issue on it
659Systems
660  Geo Nodes API
661    on primary node
662      GET /geo_nodes
663      GET /geo_nodes/:id
664      editing a Geo node
665        PUT /geo_nodes/:id for secondary node
666    on secondary node
667      GET /geo_nodes/:id
668      GET /geo_nodes
669Manage
670  Gitlab migration
671    with group member
672      member retains indirect membership in imported project
673    with project member
674      member retains direct membership in imported project
675Create
676  Pull mirror a repository over SSH with a private key
677    configures and syncs a (pull) mirrored repository
678Create
679  Cherry picking from a merge request
680    creates a merge request
681Create
682  Merge request push options
683    removes the source branch
684Create
685  Compare archives of different user projects with the same name and check they're different
686    download archives of each user project then check they are different
687Create
688  Git push to canary Gitaly node over HTTP
689    pushes to a project using a canary specific Gitaly repository storage
690Verify
691  Pipeline API defined variable inheritance
692    is determined based on forward:pipeline_variables condition
693Manage
694  User with minimal access to group
695    is not allowed to create a file via the API
696    is not allowed to commit via the API
697    is not allowed to push code via the CLI
698Framework sanity
699  Version check
700    is the specified version
701Govern
702  compliance dashboard
703    with separation of duties in an MR
704      when there are two approvals but one of the approvers is the author
705        shows only "author approved merge request" and "approved by committer" violations
706      when there is only one approval from a user other than the author
707        shows only "less than two approvers" violation
708Package
709  Dependency Proxy
710    using docker:20.10 and a personal access token
711      pulls an image using the dependency proxy
712    using docker:18.09.9 and a ci job token
713      pulls an image using the dependency proxy
714    using docker:19.03.12 and a personal access token
715      pulls an image using the dependency proxy
716    using docker:20.10 and a group deploy token
717      pulls an image using the dependency proxy
718    using docker:19.03.12 and a ci job token
719      pulls an image using the dependency proxy
720    using docker:20.10 and a ci job token
721      pulls an image using the dependency proxy
722    using docker:19.03.12 and a group deploy token
723      pulls an image using the dependency proxy
724    using docker:18.09.9 and a personal access token
725      pulls an image using the dependency proxy
726    using docker:18.09.9 and a group deploy token
727      pulls an image using the dependency proxy
728Create
729  First file using Web IDE
730    creates the first file in an empty project via Web IDE
731Plan
732  Epics roadmap
733    presents epic on roadmap
734Create
735  Testing group wiki file upload
736    by creating a formatted page with an image uploaded
737Manage
738  Group access tokens
739    can be created and revoked via the UI
740Create
741  Prereceive hook
742    when creating a tag for a ref
743      when it triggers a prereceive hook configured with a custom error
744        returns a custom server hook error
745Data Stores
746  User
747    can be followed and their activity seen
748Verify
749  Pipeline for project mirrors Github
750    user commits to GitHub triggers CI pipeline (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385252)
751Manage
752  LDAP admin sync
753    sets and removes user's admin status
754Verify
755  Pass dotenv variables to downstream via bridge
756    runs the pipeline with composed config
757Fulfillment
758  Purchase
759    User Registration
760      when adding and removing a group member
761        consumes a seat on the license
762Plan
763  Project milestone
764    creates a project milestone
765Verify
766  Pipeline with protected variable
767    exposes variable on protected branch
768    does not expose variable on unprotected branch
769Manage
770  GitHub import
771    when imported via api
772      imports project
773Data Stores
774  Project owner permissions
775    for personal projects
776      behaves like when user is added as owner
777        has owner role with owner permissions
778      behaves like when user is added as maintainer
779        has maintainer role without owner permissions
780    for group projects
781      behaves like when user is added as owner
782        has owner role with owner permissions
783      behaves like when user is added as maintainer
784        has maintainer role without owner permissions
785Manage
786  while LDAP is enabled
787    behaves like registration and login
788      allows the user to register and login
789  standard
790    when admin approval is required
791      allows user login after approval
792    when admin approval is not required
793      behaves like registration and login
794        allows the user to register and login
795      when user account is deleted
796        allows recreating with same credentials
797Plan
798  Custom email
799    customizes email with additional text
800Fulfillment
801  Purchase CI minutes
802    with existing CI minutes packs
803      adds additional minutes to group namespace
804    without active subscription
805      adds additional minutes to group namespace
806    with an active subscription
807      adds additional minutes to group namespace
808Create
809  Open Web IDE from Diff Tab
810    opens and edits a multi-file merge request in Web IDE from Diff Tab
811Manage
812  Gitlab migration
813    with ci pipeline
814      successfully imports ci pipeline
815Create
816  Multiple file snippet
817    creates a project snippet with multiple files
818Govern
819  Instance
820    for start and stop user impersonation
821      behaves like audit event
822        logs audit events for UI operations
823    for failed sign in
824      behaves like audit event
825        logs audit events for UI operations
826    for add SSH key
827      behaves like audit event
828        logs audit events for UI operations
829    for add and delete email
830      behaves like audit event
831        logs audit events for UI operations
832    for change password
833      behaves like audit event
834        logs audit events for UI operations
835    for successful sign in
836      behaves like audit event
837        logs audit events for UI operations
838Fulfillment
839  Seat overage modal
840    with premium plan
841      for member invite
842        when guest role is added
843          behaves like overage for member invite
844            shows the modal
845      for group invite
846        when inviting a group with Guest role which increases seats owed
847          behaves like overage for group invite
848            shows the modal
849    with ultimate plan
850      for member invite
851        does not show overage modal when inviting a member as a guest
852        when access level developer or above is added
853          behaves like overage for member invite
854            shows the modal
855      for group invite
856        does not show overage modal when inviting a group which does not increase seats owed
857        when inviting a group with developer role which increases seats owed
858          behaves like overage for group invite
859            shows the modal
860Verify
861  Run pipeline with manual jobs
862    does not leave any job in skipped state
863Create
864  SSH key support
865    pushes multiple branches and tags together
866    pushes code to the repository via SSH
867Systems
868  Praefect connectivity commands
869    in an unhealthy environment
870      diagnoses connection issues to gitaly nodes
871      diagnoses unhealthy connection to database
872    in a healthy environment
873      confirms healthy connection to gitaly nodes
874      confirms healthy connection to database
875Manage
876  Group SAML SSO - Non enforced SSO
877    user logs in to group with SAML SSO
878    lets group admin test settings
879    when SAML SSO is configured with a default membership role
880      adds the new member with access level as set in SAML SSO configuration
881Plan
882  Group Iterations
883    creates a group iteration automatically through an iteration cadence
884Manage
885  Gitlab migration
886    with project issues
887      successfully imports issue
888    with associated merge request
889      preserves related merge request
890    with designs
891      successfully imports design
892Fulfillment
893  Remove cloud subscription
894    successfully removes a cloud activation and shows flash notice
895  Cloud activation code
896    activates instance with correct subscription details
897Manage
898  2FA
899    allows 2FA code recovery via ssh
900Plan
901  Custom issue templates
902    creates an issue via custom template
903Create
904  Version control for project snippets
905    clones, pushes, and pulls a project snippet over HTTP, edits via UI
906    clones, pushes, and pulls a project snippet over SSH, deletes via UI
907Create
908  PostReceive idempotent
909    repeatedly pushes and creates a single push event several times
910    pushes and creates a single push event three times
911Create
912  Codeowners
913    merge request assigns code owners as approvers
914Plan
915  mention
916    mentions another user in an issue
917Fulfillment
918  Utilization
919    when Saas user limit experience feature flags are enabled
920      new group enforcement removed when trial started
921      enforcement limit counts includes invited group and project members
922      limit overage enforcement removed from private group when trial is started
923      preview notification displayed for private group when over limit
924      enforcement does not allow adding more members
925Plan
926  Default issue templates
927    uses default template when creating an issue
928Create
929  Default branch name instance setting
930    allows a project to be created via the CLI with a different default branch name
931    sets the default branch name for a new project
932Manage
933  User
934    after parent group membership termination
935      is not allowed to push code via the CLI
936      is not allowed to commit via the API
937      is not allowed to create a file via the API
938Manage
939  Group access token
940    can be used to commit via the API
941    can be used to create a file via the project API
942Manage
943  Project import
944    imports large Github repo via api
945Configure
946  Auto DevOps with a Kubernetes Agent
947    runs auto devops
948Create
949  Source editor toolbar preview
950    can preview markdown side-by-side while editing
951Verify
952  Runner registration
953    user registers a new project runner
954Create
955  Repository License Detection
956    on a project with an unrecognized LICENSE
957      behaves like project license detection
958        displays the name of the license on the repository
959    on a project with a commonly used LICENSE
960      behaves like project license detection
961        displays the name of the license on the repository
962Manage
963  2FA
964    allows using 2FA recovery code once only
965Systems
966  GitLab SSH push
967    when regular git commit
968      is replicated to the secondary
969    when git-lfs commit
970      is replicated to the secondary
971Data Stores
972  Group member access request
973    generates a todo item for the group owner
974    when managing requests as the group owner
975      and request is accepted
976        adds user to the group
977      and request is denied
978        does not add user to the group
979Plan
980  Configurable issue board
981    renames the issue board
982Create
983  Create a new merge request from the event notification after a push
984    creates a merge request after a push via the API
985    creates a merge request after a push via the git CLI
986Manage
987  Project access tokens
988    can be created and revoked via the UI
989Manage
990  Jira issues integration
991    views an issue
992    shows open issues
993    searching issues returns results
994Manage
995  WebHooks integration
996    sends a tag event
997    sends a push event
998    sends a wiki page event
999    sends an issues and note event
1000    sends a merge request event
1001    when hook fails
1002      hook is auto-disabled (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/393274)
1003Systems
1004  GitLab Geo project rename replication
1005    user renames project
1006Monitor
1007  Alert with escalation policy
1008    notifies on-call user via system note and email on new alert
1009Verify
1010  Pipeline with project file variables
1011    does not expose file variable content with echo
1012    can read file variable content with cat
1013Create
1014  Codeowners
1015    when the project is in a subgroup
1016      and the code owner is the subgroup
1017        behaves like code owner merge request
1018          is approved and merged
1019      and the code owner is the root group
1020        behaves like code owner merge request
1021          is approved and merged
1022      and the code owner is a user
1023        behaves like code owner merge request
1024          is approved and merged
1025Verify
1026  Trigger child pipeline with 'when:manual'
1027    can trigger bridge job
1028Plan
1029  Assignees
1030    update without refresh
1031Verify
1032  Unlocking job artifacts across parent-child pipelines
1033    without strategy:depend
1034      when latest pipeline family is successful
1035        unlocks job artifacts from previous successful pipeline family (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1036      when latest child pipeline failed
1037        unlocks job artifacts from previous successful pipeline family because the latest parent is successful (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1038      when latest parent pipeline failed
1039        does not unlock job artifacts from previous successful pipeline family (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1040    with strategy:depend
1041      when latest parent pipeline failed
1042        does not unlock job artifacts from previous successful pipeline family (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1043      when latest child pipeline failed
1044        does not unlock job artifacts from previous successful pipeline family (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1045      when latest pipeline family is successful
1046        unlocks job artifacts from previous successful pipeline family (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855)
1047Manage
1048  Gitlab migration
1049    with merge request
1050      successfully imports merge request
1051Systems
1052  Praefect dataloss commands
1053    allows admin resolve scenario where data cannot be recovered
1054    identifies how many changes are not in sync across storages
1055    confirms that changes are synced across all storages
1056Create
1057  File management
1058    user creates a file via the Web
1059Verify
1060  Run pipeline
1061    with web only rule
1062      can trigger pipeline
1063Verify
1064  When user is blocked
1065    pipeline schedule is canceled
1066Verify
1067  In merge trains
1068    new thread discussion
1069      does not drop MR
1070Create
1071  Approval rules
1072    allows multiple approval rules with users and groups
1073Manage
1074  basic user
1075    remains logged in when redirected from canary to non-canary node (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/344213)
1076Data Stores
1077  When using elasticsearch API to search for a public note
1078    finds note that matches note body
1079Systems
1080  Changing Gitaly repository storage
1081    when moving from Gitaly to Gitaly Cluster
1082      behaves like repository storage move
1083        confirms a `finished` status after moving project repository storage
1084    when moving from Gitaly Cluster to Gitaly
1085      behaves like repository storage move
1086        confirms a `finished` status after moving project repository storage
1087    when moving from one Gitaly storage to another
1088      behaves like repository storage move
1089        confirms a `finished` status after moving project repository storage
1090Plan
1091  collapse comments in issue discussions
1092    collapses and expands reply for comments in an issue
1093Verify
1094  UI defined variable
1095    is not inheritable when forward:pipeline_variables is false
1096    is not inheritable by default
1097Plan
1098  Design Management
1099    user archives a design
1100Data Stores
1101  Add project member
1102    user adds project member
1103Manage
1104  Group SAML SSO - Enforced SSO
1105    with Snowplow tracking disabled
1106      behaves like group membership actions
1107        creates a new account automatically and allows to leave group and join again
1108    with Snowplow tracking enabled
1109      behaves like group membership actions
1110        creates a new account automatically and allows to leave group and join again
1111Plan
1112  Read-only board configuration
1113    shows board configuration to user without edit permission
1114Create
1115  Gitaly repository storage
1116    creates a 2nd fork after moving the parent project
1117Release
1118  Deploy key creation
1119    user adds a deploy key
1120Create
1121  with merge request batch suggestions
1122    applies multiple suggestions
1123Create
1124  Cherry picking a commit
1125    creates a merge request
1126Systems
1127  Gitaly Cluster replication queue
1128    allows replication of different repository after interruption
1129Create
1130  Project templates
1131    when built-in
1132      successfully imports the project using template
1133    when group level
1134      successfully imports the project using template
1135    when instance level
1136      successfully imports the project using template
1137Data Stores
1138  Create project badge
1139    creates project badge successfully
1140Release
1141  Deploy token creation
1142    user adds a deploy token
1143Data Stores
1144  When using elasticsearch API to search for a known blob
1145    searches public project and finds a blob as an non-member user
1146Fulfillment
1147  Utilization
1148    in usage quotas
1149      user seat data is displayed correctly
1150Data Stores
1151  When using elasticsearch API to search for a known blob
1152    searches public project and finds a blob as an non-member user
1153    When searching a private repository
1154      does not find a blob as an non-member user
1155      finds a blob as an authorized user
1156Create
1157  Testing group wiki
1158    can delete a group wiki page
1159Secure
1160  Enable Scanning from UI
1161    enable sast from configuration
1162      runs sast job when enabled from configuration
1163    license compliance shows status in configuration
1164      shows correct status in configuration
1165    enable dependency scanning from configuration
1166      runs dependency scanning job when enabled from configuration
1167Data Stores
1168  Check for broken images
1169    when logged in as a new user
1170      behaves like loads all images
1171        loads all images
1172    when logged in as a new admin
1173      behaves like loads all images
1174        loads all images
1175Plan
1176  Assign Iterations
1177    assigns a group iteration to an existing issue
1178Growth
1179  SaaS trials
1180    starts a free trial
1181      when on about page with multiple eligible namespaces
1182        registers for a new trial
1183      when on billing page with only one eligible namespace
1184        registers for a new trial
1185Plan
1186  Epics Management
1187    creates a confidential epic
1188    creates an epic
1189    Resources created via API
1190      adds/removes issue to/from epic using quick actions
1191      Visit epic first
1192        comments on epic
1193        adds/removes issue to/from epic
1194        closes and reopens an epic
1195GitLab Metrics
1196  Web metrics
1197    via Rails controller endpoint
1198      returns 200 OK and serves metrics
1199    via dedicated server
1200      returns 200 OK and serves metrics
1201  Sidekiq metrics
1202    via dedicated server
1203      returns 200 OK and serves metrics
1204Create
1205  Upload a file in Web IDE
1206    when the file is binary
1207      shows a Download button
1208    when the file is an image
1209      shows an image viewer
1210    when the file is a text file
1211      shows the Edit tab with the text
1212    when a file with the same name already exists
1213      throws an error
1214Verify
1215  Pipeline editor
1216    when CI has valid syntax
1217      shows valid validations
1218    when CI has invalid syntax
1219      shows invalid validations
1220Create
1221  batch comments in merge request
1222    user submits a diff review
1223    user submits a non-diff review
1224Create
1225  Version control for personal snippets
1226    clones, pushes, and pulls a snippet over SSH, deletes via UI
1227    clones, pushes, and pulls a snippet over HTTP, edits via UI
1228Manage
1229  Group access
1230    when restricted by another ip address
1231      with SSH
1232        denies access
1233      with API
1234        denies access
1235      with UI
1236        denies access
1237    when restricted by user's ip address
1238      with API
1239        allows access
1240      with UI
1241        allows access
1242      with SSH
1243        allows access
1244Create
1245  Branch with unusual name
1246    when branch name contains slash, hash, double dash, and capital letter
1247      renders repository file tree correctly (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/364565)
1248Create
1249  Create, list, and delete branches via web
1250    lists branches correctly after CRUD operations
1251Monitor
1252  Alert
1253    when using Prometheus integration
1254      behaves like new alert
1255        automatically creates new incident
1256    when using HTTP endpoint integration
1257      behaves like new alert
1258        automatically creates new incident
1259Create
1260  Group Wiki repository storage
1261    moves group Wiki repository from one Gitaly storage to another
1262Create
1263  Pages
1264    creates a Pages website
1265Create
1266  Merged merge request
1267    can be reverted
1268Plan
1269  Email Notification
1270    is received by a user for project invitation
1271Create
1272  File with unusual name
1273    when file name starts with a dash and contains hash, semicolon, colon, and question mark
1274      renders repository file tree correctly
1275Verify
1276  Pipeline editor
1277    can switch branches and target branch field updates accordingly
1278Create
1279  push after setting the file size limit via admin/application_settings
1280    push fails when the file size is above the limit
1281    push successful when the file size is under the limit
1282Plan
1283  Sum of issues weights on issue board
1284    shows the sum of issues weights in the board list's header
1285Secure
1286  License merge request widget
1287    when a license scanning report exists
1288      manage licenses from the merge request
1289    when a CycloneDX SBOM file exists
1290      manage licenses from the merge request
1291Plan
1292  Group issue boards
1293    shows multiple group boards in the boards dropdown menu
1294Systems
1295  Project snippet
1296    replicates to the Geo secondary site
1297Verify
1298  Multi-project pipelines
1299    creates a multi-project pipeline with artifact download
1300Data Stores
1301  User
1302    when parent group membership is terminated
1303      is not allowed to edit the project files
1304Package
1305  Dependency Proxy Group SSO
1306    pulls an image using the dependency proxy on a group enforced SSO
1307Manage
1308  GitHub import
1309    when imported via UI
1310      imports a project
1311Create
1312  Push mirror a repository over HTTP
1313    configures and syncs LFS objects for a (push) mirrored repository
1314Manage
1315  Gitlab migration
1316    migrates large gitlab group via api
1317Plan
1318  Related issues
1319    relates and unrelates one issue to/from another
1320Create
1321  Testing wiki content creation inside a project
1322    by adding a home page to the wiki
1323    by adding a home page to the wiki using git push
1324    by adding a second page to the wiki using git push
1325    by adding a second page to the wiki
1326Package
1327  Helm Registry
1328    using personal access token
1329      pushes and pulls a helm chart
1330    using ci job token
1331      pushes and pulls a helm chart
1332    using project deploy token
1333      pushes and pulls a helm chart
1334Package
1335  Maven request forwarding
1336    uses GitLab as a mirror of the central proxy (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/378221)
1337  Maven group level endpoint
1338    duplication setting
1339      when enabled
1340        allows users to publish duplicates
1341      when disabled
1342        prevents users from publishing duplicates
1343    via maven
1344      using a ci job token
1345        pushes and pulls a maven package
1346      using a personal access token
1347        pushes and pulls a maven package
1348      using a project deploy token
1349        pushes and pulls a maven package
1350Data Stores
1351  When using advanced search API to search for a user
1352    finds the user that matches username
1353Package
1354  Maven request forwarding
1355    uses GitLab as a mirror of the central proxy (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/378221)
1356  Maven project level endpoint
1357    using a personal access token
1358      pushes and pulls a maven package via maven
1359    using a ci job token
1360      pushes and pulls a maven package via maven
1361    using a project deploy token
1362      pushes and pulls a maven package via maven
1363Verify
1364  Pipelines for merged results and merge trains
1365    creates a pipeline with merged results
1366    merges via a merge train
1367Create
1368  Setup an MR with codeowners file
1369    creates a merge request with codeowners file and squashing commits enabled
1370Data Stores
1371  Project
1372    in personal namespace
1373      behaves like successful project creation
1374        creates a new project
1375    in group
1376      behaves like successful project creation
1377        creates a new project
1378Create
1379  Multiple file snippet
1380    creates a personal snippet with multiple files
1381Systems
1382  GitLab wiki SSH push
1383    when wiki commit
1384      is replicated to the secondary
1385Package
1386  Package Registry
1387    npm project level endpoint
1388      using ci job token
1389        push and pull a npm package via CI
1390      using personal access token
1391        push and pull a npm package via CI
1392      using project deploy token
1393        push and pull a npm package via CI
1394Create
1395  Merge request creation from fork
1396    can merge feature branch fork to mainline
1397Fulfillment
1398  with existing CI minutes packs
1399    behaves like Purchase storage
1400      adds additional storage to group namespace
1401  without active subscription
1402    behaves like Purchase storage
1403      adds additional storage to group namespace
1404  with an active subscription
1405    behaves like Purchase storage
1406      adds additional storage to group namespace
1407Create
1408  File management
1409    user deletes a file via the Web
1410Manage
1411  User with minimal access to group
1412    is not allowed to edit files via the UI
1413Framework sanity
1414  Failing orchestrated example
1415    fails
1416  Passing orchestrated example
1417    succeeds
1418Create
1419  Create a new project from a template
1420    commits via the api
1421Create
1422  Merge request rebasing
1423    user rebases source branch of merge request
1424Verify
1425  Include multiple files from a project
1426    runs the pipeline with composed config
1427Create
1428  Personal snippet creation
1429    user creates a personal snippet
1430Verify
1431  When CI job log is archived and geo is enabled
1432    continues to display the archived trace
1433Framework sanity
1434  Browser request interception
1435    intercepts failed graphql calls
1436Verify
1437  Cancelling merge request in merge train
1438    when user cancels the merge request
1439      does not create a TODO task
1440Govern
1441  project vulnerability report
1442    can successfully bulk change status in vulnerability report
1443    can successfully change status of a vulnerability in vulnerability details page
1444Verify
1445  Pipeline with raw variables in YAML
1446    expands variables according to expand: true/false
1447Verify
1448  Add or Remove CI variable via UI
1449    user adds a CI variable
1450    user removes a CI variable
1451Manage
1452  Pipeline status emails
1453    when pipeline fails
1454      sends an email
1455    when pipeline passes
1456      sends an email
1457Govern
1458  Group
1459    for enable and disable allow user request access
1460      behaves like audit event
1461        logs audit events for UI operations
1462    for disable and Enable LFS
1463      behaves like audit event
1464        logs audit events for UI operations
1465    for enable and disable 2FA requirement
1466      behaves like audit event
1467        logs audit events for UI operations
1468    for enable and disable membership lock
1469      behaves like audit event
1470        logs audit events for UI operations
1471    for change project creation level
1472      behaves like audit event
1473        logs audit events for UI operations
1474Govern
1475  Project vulnerability report
1476    validates "fix a vulnerability" workflow
1477Manage
1478  Jira integration
1479    closes an issue via pushing a commit
1480    closes an issue via a merge request
1481Data Stores
1482  Project transfer between groups
1483    user transfers a project between groups
1484Create
1485  Merge request push options
1486    sets merge when pipeline succeeds
1487    merges when pipeline succeeds
1488Configure
1489  Kubernetes Agent
1490    deploys a K8s manifest file
1491Data Stores
1492  User
1493    when added to parent group
1494      is allowed to commit to sub-group project via the API
1495      is allowed to push code to sub-group project via the CLI
1496      is allowed to create a file in sub-group project via the API
1497    when added to sub-group
1498      is not allowed to commit to parent group project via the API
1499      is not allowed to push code to parent group project via the CLI
1500      is not allowed to create a file in parent group project via the API
1501Analytics
1502  Service ping default enabled
1503    when using default enabled from gitlab.yml config
1504      has service ping toggle enabled
1505Systems
1506  GitLab Geo HTTP push secondary
1507    when git-lfs commit
1508      is redirected to the primary and ultimately replicated to the secondary
1509    when regular git commit
1510      is redirected to the primary and ultimately replicated to the secondary
1511Create
1512  Testing project wiki file upload
1513    by creating a formatted page with an image uploaded
1514Govern
1515  Compliance Framework Report
1516    shows the compliance framework for each project
1517Govern
1518  Vulnerability report in a project
1519    can export vulnerability report to csv
1520Verify
1521  Pipeline subscription with a group owned project
1522    when upstream project new tag pipeline finishes
1523      triggers pipeline in downstream project
1524Create
1525  Git push over HTTP
1526    user pushes code to the repository
1527    pushes to a project using a specific Praefect repository storage
1528Fulfillment
1529  Purchase
1530    group plan
1531      upgrades from free to ultimate
1532      with existing CI minutes pack
1533        upgrades from free to premium with correct CI minutes
1534Create
1535  Codeowners
1536    displays owners specified in CODEOWNERS file
1537Manage
1538  Instance wide SAML SSO
1539    user logs in to gitlab with SAML SSO
1540Govern
1541  Policies List page
1542    can load Policies page and view the policies list
1543    can navigate to Policy Editor page
1544Create
1545  Git Server Hooks
1546    with custom error messages
1547      renders preconfigured error message when user hook failed on commit in WebIDE
1548Data Stores
1549  Invite group
1550    with a personal namespace project
1551      behaves like invites group to project
1552        verifies group is added and members can access project with correct access level
1553    with a group project
1554      behaves like invites group to project
1555        verifies group is added and members can access project with correct access level
1556Data Stores
1557  When using Advanced Search API to search for a public commit
1558    finds commit that matches commit message
1559Create
1560  Add a directory in Web IDE
1561    when user adds a new empty directory
1562      shows successfully but not able to be committed (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399544)
1563    when a directory with the same name already exists
1564      throws an error
1565Plan
1566  Milestones
1567    Project milestone
1568      behaves like milestone assigned to existing issue
1569        is assigned to an existing issue
1570      behaves like milestone assigned to new issue
1571        is assigned to a new issue
1572    Group milestone
1573      behaves like milestone assigned to new issue
1574        is assigned to a new issue
1575      behaves like milestone assigned to existing issue
1576        is assigned to an existing issue
1577Analytics
1578  Performance bar display
1579    when logged in as an admin user
1580      shows results for the original request and AJAX requests
1581Govern
1582  Vulnerability management in a merge request
1583    can dismiss a vulnerability with a reason from mr security widget
1584    can create an issue from a security finding in pipeline security tab
1585    can dismiss a security finding with reason from pipeline security tab
1586    can create an auto-remediation MR from mr security widget
1587    can create an issue from a vulnerability from mr security widget
1588Monitor
1589  Alert settings
1590    when using HTTP endpoint integration
1591      behaves like sends test alert
1592        creates new alert
1593    when using Prometheus integration
1594      behaves like sends test alert
1595        creates new alert
1596Create
1597  Git push over HTTP
1598    user using a personal access token pushes code to the repository
1599Create
1600  Push over HTTP using Git protocol version 2
1601    user pushes to the repository
1602Package
1603  Generic Repository
1604    uploads a generic package and downloads it
1605Govern
1606  Security Reports
1607    dependency list has empty state
1608    displays security reports in the project security dashboard
1609    displays false positives for the vulnerabilities
1610    displays security reports in the group security dashboard
1611    displays the Dependency List
1612    displays security reports in the pipeline
1613Manage
1614  Gitlab migration
1615    with EE features
1616      imports group epics and iterations
1617Manage
1618  2FA
1619    allows enforcing 2FA via UI and logging in with 2FA
1620Release
1621  Git clone using a deploy key
1622    user sets up a deploy key with QA::Runtime::Key::ECDSA(521) to clone code using pipelines
1623    user sets up a deploy key with QA::Runtime::Key::ED25519(256) to clone code using pipelines
1624    user sets up a deploy key with QA::Runtime::Key::RSA(8192) to clone code using pipelines
1625Create
1626  Adding comments on snippets
1627    behaves like comments on snippets
1628      adds, edits, and deletes a comment on a personal_snippet
1629    behaves like comments on snippets
1630      adds, edits, and deletes a comment on a project_snippet
1631Data Stores
1632  prevent forking outside group
1633    when disabled
1634      allows forking outside of group
1635    when enabled
1636      does not allow forking outside of group
1637Manage
1638  Mattermost login
1639    user logs into Mattermost using GitLab OAuth
1640Data Stores
1641  Project activity
1642    user creates an event in the activity page upon Git push
1643Verify
1644  Endpoint Coverage
1645    spans r/w postgres web sidekiq git api
1646Create
1647  Merge request custom templates
1648    creates a merge request via custom template
1649Verify
1650  Merge trains transient bugs
1651    confirms that a merge train consistently completes and updates the UI
1652Manage
1653  LDAP login
1654    user logs into GitLab using LDAP credentials
1655Plan
1656  Issue comments
1657    comments on an issue and edits the comment
1658Manage
1659  Gitlab migration
1660    with subgroups and labels
1661      successfully imports groups and labels
1662    with milestones and badges
1663      successfully imports group milestones and badges
1664Create
1665  Project Wiki
1666    with Wiki Page List
1667      has all expected links that work
1668    with Wiki Sidebar
1669      has all expected links that work
1670Create
1671  Creating pages in group wikis
1672    when wiki has a home page
1673      adds a second page
1674    when wiki is empty
1675      creates a new page
1676Verify
1677  Pipeline with image:pull_policy
1678    when policy is not allowed
1679      fails job with policy not allowed message
1680    when policy is allowed
1681      with [always if-not-present] policies
1682        applies pull policy in job correctly
1683      with [always] policy
1684        applies pull policy in job correctly
1685      with [if-not-present] policy
1686        applies pull policy in job correctly
1687      with [never] policy
1688        applies pull policy in job correctly
1689Data Stores
1690  Search using Elasticsearch
1691    tests reindexing after push (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385927)
1692    tests reindexing after webIDE (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385927)
1693Create
1694  Push Rules
1695    using non signed commits
1696      restricts commit by message format
1697      allows an unrestricted push
1698      restricts branches by branch name
1699      restricts users by email format
1700      restricts removal of tag
1701      restricts files by name and size
1702      restricts committing files with secrets
1703    with commits restricted to verified emails
1704      rejects unverified emails
1705    with commits restricted by author email to existing GitLab users
1706      rejects non-member users
1707    using signed commits
1708      restricts to signed commits
1709Plan
1710  Issues weight visualization
1711    shows the set weight in the issue page, in the milestone page, and in the issues list page
1712Package
1713  Self-managed Container Registry
1714    when tls is disabled
1715      using docker:18.09.9 and a personal access token
1716        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1717      using docker:20.10 and a personal access token
1718        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1719      using docker:19.03.12 and a personal access token
1720        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1721      using docker:19.03.12 and a project deploy token
1722        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1723      using docker:19.03.12 and a ci job token
1724        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1725      using docker:20.10 and a project deploy token
1726        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1727      using docker:18.09.9 and a ci job token
1728        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1729      using docker:18.09.9 and a project deploy token
1730        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1731      using docker:20.10 and a ci job token
1732        pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1733    when tls is enabled
1734      pushes image and deletes tag (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556)
1735Plan
1736  Issue board focus mode
1737    focuses on issue board
1738Systems
1739  GitLab wiki SSH push to secondary
1740    proxies wiki commit to primary node and ultmately replicates to secondary node
1741Secure
1742  License Compliance
1743    has empty state
1744    when a license management report exists
1745      License Management
1746        behaves like deny license
1747          can deny a license in the settings page
1748        Pipeline Licence tab
1749          behaves like pipeline license display
1750            can approve and deny licenses in the pipeline
1751        behaves like approve license
1752          can approve a license in the settings page
1753    when a CycloneDX SBOM file exists
1754      License Management
1755        Pipeline Licence tab
1756          behaves like pipeline license display
1757            can approve and deny licenses in the pipeline
1758        behaves like deny license
1759          can deny a license in the settings page
1760        behaves like approve license
1761          can approve a license in the settings page
1762Plan
1763  Issue creation
1764    creates an issue
1765    closes an issue
1766    when using attachments in comments
1767      comments on an issue with an attachment
1768Verify
1769  UI defined variable
1770    is inheritable when forward:pipeline_variables is true
1771Fulfillment
1772  Utilization
1773    in ultimate plan billing settings
1774      displays correct information for seat usage
1775Create
1776  Review a merge request in Web IDE
1777    opens and edits a merge request in Web IDE
1778Create
1779  Repository tags
1780    when not protected
1781      behaves like successful tag creation
1782        can be created by maintainer_user
1783      behaves like successful tag creation
1784        can be created by developer_user
1785    when protected
1786      behaves like successful tag creation
1787        can be created by maintainer_user
1788      behaves like unsuccessful tag creation
1789        cannot be created by an unauthorized developer_user
1790Systems
1791  GitLab Geo project deletion replication
1792    replicates deletion of a project to secondary node
1793Verify
1794  Code coverage statistics
1795    creates an MR with code coverage statistics
1796Manage
1797  LDAP Group sync
1798    user filter method
1799      behaves like Group sync
1800        can create group access tokens
1801        has LDAP users synced
1802        can create project access tokens
1803    using group cn method
1804      behaves like Group sync
1805        can create project access tokens
1806        has LDAP users synced
1807        can create group access tokens
1808Manage
1809  basic user login
1810    user logs in using basic credentials and logs out
1811ModelOps
1812  Suggested Reviewers
1813    suggests reviewers
1814Systems
1815  Gitaly distributed reads
1816    reads from each node
1817    when a node is unhealthy
1818      does not read from the unhealthy node
1819Create
1820  Snippet repository storage
1821    moves snippet repository from one Gitaly storage to another
1822Verify
1823  Trigger matrix
1824    creates 2 trigger jobs and passes corresponding matrix variables
1825Plan
1826  Multiple assignees per issue
1827    shows the first five assignees and a +n more link in the issue page
1828    shows the first three assignees and a +n sign in the issues list
1829Verify
1830  Unlocking job artifacts across pipelines
1831    when latest pipeline failed
1832      unlocks job artifacts from failed pipelines, keeps job artifacts from latest successful pipeline (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/266958)
1833    when latest pipeline is successful
1834      unlocks job artifacts from previous successful pipeline
1835Package
1836  PyPI Repository
1837    Geo
1838      replicates a published pypi package to the Geo secondary site (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/325556)
1839    when at the project level
1840      publishes and installs a pypi package
1841Systems
1842  Gitaly using mTLS
1843    pushes to gitaly
1844Package
1845  Container Registry
1846    pushes, pulls image to the registry and deletes tag
1847Manage
1848  rate limits
1849    throttles authenticated api requests by user
1850Govern
1851  Security Dashboard in a Project
1852    creates an issue from vulnerability details
1853    shows vulnerability details
1854Systems
1855  GitLab wiki HTTP push
1856    when wiki commit
1857      is replicated to the secondary node
1858Plan
1859  Multiple assignees per issue
1860    shows four assignees in the issues list
1861Manage
1862  Group WebHooks integration
1863    sends subgroup events
1864    when hook fails
1865      group hooks do not auto-disable
1866Create
1867  Merge request squashing
1868    user squashes commits while merging
1869Plan
1870  Project level issues analytics
1871    behaves like issues analytics page
1872      displays a graph
1873  Group level issues analytics
1874    behaves like issues analytics page
1875      displays a graph
1876Systems
1877  GitLab Geo Wiki HTTP push secondary
1878    is redirected to the primary and ultimately replicated to the secondary
1879Package
1880  Maven Repository with Gradle
1881    using ci job token
1882      pushes and pulls a maven package via gradle
1883    using personal access token
1884      pushes and pulls a maven package via gradle
1885    using project deploy token
1886      pushes and pulls a maven package via gradle
1887Configure
1888  AutoDevOps Templates
1889    using express template
1890      works with Auto DevOps
1891Create
1892  Slack app integration
1893    when using Slash commands
1894      creates an issue
1895      with gitlab issue
1896        comments on an issue
1897        closes an issue
1898        displays an issue
1899        with target project
1900          moves an issue
1901Create
1902  Repository Usage Quota
1903    matches cloned repo usage to reported usage
1904Create
1905  File management
1906    user edits a file via the Web
1907Manage
1908  GitHub import
1909    when imported via api
1910      imports repo push rules
1911Package
1912  NuGet group level endpoint
1913    using group deploy token
1914      publishes a nuget package at the project endpoint and installs it from the group endpoint
1915    using personal access token
1916      publishes a nuget package at the project endpoint and installs it from the group endpoint
1917    using ci job token
1918      publishes a nuget package at the project endpoint and installs it from the group endpoint
1919Plan
1920  Design Management
1921    user adds a design and modifies it
1922Plan
1923  Discussion comments transient bugs
1924    comments with mention on a discussion in an issue
1925Verify
1926  Cancelling merge request in merge train
1927    when system cancels the merge request
1928      creates a TODO task (PENDING: In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/324122)
1929Framework sanity
1930  Feature flag handler checks
1931    with an existing feature flag definition file
1932      reads the correct default enabled state
1933    feature flag definition files
1934      with an EE feature flag
1935        with a default enabled feature flag
1936          reads the flag as enabled
1937          reads as disabled after the flag is disabled
1938        with a default disabled feature flag
1939          reads as enabled after the flag is enabled
1940          reads the flag as disabled
1941      with a CE feature flag
1942        with a default disabled feature flag
1943          reads as enabled after the flag is enabled
1944          reads the flag as disabled
1945        with a default enabled feature flag
1946          reads the flag as enabled
1947          reads as disabled after the flag is disabled
1948Data Stores
1949  User
1950    when added to parent group
1951      is allowed to edit the sub-group project files
1952    when added to sub-group
1953      is not allowed to edit the parent group project files
1954Create
1955  SSH keys support
1956    user can add an SSH key
1957    after adding an ssh key
1958      can delete an ssh key
1959Verify
1960  Pipeline with customizable variable
1961    manually creates a pipeline and uses the defined custom variable value
1962Create
1963  File Locking
1964    creates a merge request and fails to merge
1965    checks file locked by other user to be disabled
1966    locks a directory and tries to push as a second user
1967    locks a file and tries to push as a second user
1968    locks a file and unlocks in list
1969Systems
1970  GitLab Geo attachment replication
1971    user uploads attachment to the primary node
1972Plan
1973  for group insights page
1974    behaves like default insights page
1975      displays issues and merge requests dashboards
1976  for project insights page
1977    behaves like default insights page
1978      displays issues and merge requests dashboards
1979Govern
1980  Group
1981    for add group
1982      behaves like audit event
1983        logs audit events for UI operations
1984    for add user, change access level, remove user
1985      behaves like audit event
1986        logs audit events for UI operations
1987    for update group name
1988      behaves like audit event
1989        logs audit events for UI operations
1990    for change repository size limit
1991      behaves like audit event
1992        logs audit events for UI operations
1993    for add and remove project access
1994      behaves like audit event
1995        logs audit events for UI operations
1996Create
1997  Protected branch support
1998    when developers and maintainers are allowed to push to a protected branch
1999      user with push rights successfully pushes to the protected branch
2000    when developers and maintainers are not allowed to push to a protected branch
2001      user without push rights fails to push to the protected branch
2002Create
2003  Snippet index page
2004    behaves like displaying details on index page
2005      shows correct details of project_snippet_with_single_file including file number
2006    behaves like displaying details on index page
2007      shows correct details of personal_snippet_with_single_file including file number
2008    behaves like displaying details on index page
2009      shows correct details of project_snippet_with_multiple_files including file number
2010    behaves like displaying details on index page
2011      shows correct details of personal_snippet_with_multiple_files including file number
2012Package
2013  NuGet project level endpoint
2014    using a project deploy token
2015      publishes a nuget package and installs
2016    using a ci job token
2017      publishes a nuget package and installs
2018    using a personal access token
2019      publishes a nuget package and installs
2020Package
2021  Composer Repository
2022    publishes a composer package and deletes it
2023Plan
2024  Issue
2025    closes via pushing a commit
2026Plan
2027  check xss occurence in @mentions in issues
2028    mentions a user in a comment
2029Create
2030  Sharing snippets
2031    when the snippet is changed to private
2032      does not display Embed/Share dropdown
2033    when the snippet is public
2034      can be shared with not signed-in users
2035Data Stores
2036  When using elasticsearch API to search for a public issue
2037    finds issue that matches description
2038Create
2039  Multiple file snippet
2040    behaves like copying snippet file contents
2041      copies file contents of a multi-file project_snippet to a comment and verifies them
2042    behaves like copying snippet file contents
2043      copies file contents of a multi-file personal_snippet to a comment and verifies them
2044Create
2045  Commit data
2046    user views raw email patch
2047    user views raw commit diff
2048Package
2049  Package Registry
2050    npm instance level endpoint
2051      using ci job token
2052        push and pull a npm package via CI
2053      using personal access token
2054        push and pull a npm package via CI
2055      using project deploy token
2056        push and pull a npm package via CI
2057Create
2058  Download merge request patch and diff
2059    views the merge request email patches
2060    views the merge request plain diff
2061Verify
2062  when pipeline is blocked
2063    can still merge MR successfully
2064Analytics
2065  Service ping disabled
2066    when disabled from gitlab.yml config
2067      has service ping toggle is disabled
2068Systems
2069  Praefect repository commands
2070    allows admin to control the number of replicas of data
2071    allows admin to manage difference between praefect database and disk state
2072Verify
2073  Parent-child pipelines dependent relationship
2074    parent pipeline fails if child fails
2075    parent pipelines passes if child passes
2076Create
2077  with merge request suggestions
2078    applies a single suggestion with a custom message
2079Create
2080  Add a directory in Web IDE
2081    when a directory with the same name already exists
2082      throws an error
2083    when user adds a new empty directory
2084      shows in the tree view but cannot be committed
2085Plan
2086  Epics milestone dates API
2087    updates epic dates when updating milestones
2088    updates epic dates when removing issue
2089    updates epic dates when adding another issue
2090    updates epic dates when deleting milestones
2091Plan
2092  Issues list
2093    successfully exports issues list as CSV
2094Data Stores
2095  Users API
2096    GET /users/:username with an invalid username
2097    GET /users
2098    GET /users/:username with a valid username
2099Manage
2100  Project access token
2101    for a different project
2102      cannot be used to create a file via the project API
2103      cannot be used to commit via the API
2104    for the same project
2105      can be used to commit via the API
2106      can be used to create a file via the project API
2107Create
2108  Merge request push options
2109    sets a target branch
2110Create
2111  Push mirror a repository over HTTP
2112    configures and syncs a (push) mirrored repository
2113Create
2114  Merge requests
2115    when merging once
2116      behaves like merge when pipeline succeeds
2117        merges after pipeline succeeds
2118    when merging several times
2119      behaves like merge when pipeline succeeds
2120        merges after pipeline succeeds
2121Create
2122  Reverting a commit
2123    creates a merge request
2124Monitor
2125  Alert
2126    when user is a maintainer
2127      when using HTTP endpoint integration
2128        behaves like notification on new alert
2129          sends email to user
2130      when using Prometheus integration
2131        behaves like notification on new alert
2132          sends email to user
2133    when user is an owner
2134      when using Prometheus integration
2135        behaves like notification on new alert
2136          sends email to user
2137      when using HTTP endpoint integration
2138        behaves like notification on new alert
2139          sends email to user
2140[Mar 28 2023 14:58:05 UTC (QA Tests)] WARN  -- [influxdb exporter]: Missing run_type, skipping metrics export!
2141Pending: (Failures listed here are expected and do not affect your suite's status)
2142  1) Fulfillment Utilization in usage quotas storage tab for free plan with a project shows correct used up storage for namespace
2143     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/398115
2144     # ./qa/specs/features/ee/browser_ui/11_fulfillment/utilization/free_namespace_storage_spec.rb:57
2145  2) Verify Pipeline for project mirrors Github user commits to GitHub triggers CI pipeline
2146     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385252
2147     # ./qa/specs/features/ee/browser_ui/4_verify/pipeline_for_project_mirror_github_spec.rb:69
2148  3) Manage WebHooks integration when hook fails hook is auto-disabled
2149     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/393274
2150     # ./qa/specs/features/api/1_manage/integrations/webhook_events_spec.rb:114
2151  4) Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
2152     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2153     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:54
2154  5) Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest child pipeline failed unlocks job artifacts from previous successful pipeline family because the latest parent is successful
2155     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2156     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:140
2157  6) Verify Unlocking job artifacts across parent-child pipelines without strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
2158     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2159     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:95
2160  7) Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest parent pipeline failed does not unlock job artifacts from previous successful pipeline family
2161     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2162     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:235
2163  8) Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest child pipeline failed does not unlock job artifacts from previous successful pipeline family
2164     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2165     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:280
2166  9) Verify Unlocking job artifacts across parent-child pipelines with strategy:depend when latest pipeline family is successful unlocks job artifacts from previous successful pipeline family
2167     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/396855
2168     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_parent_child_pipelines_spec.rb:194
2169  10) Manage basic user remains logged in when redirected from canary to non-canary node
2170     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/344213
2171     # ./qa/specs/features/browser_ui/1_manage/login/maintain_log_in_mixed_env_spec.rb:6
2172  11) Create Branch with unusual name when branch name contains slash, hash, double dash, and capital letter renders repository file tree correctly
2173     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/364565
2174     # ./qa/specs/features/browser_ui/3_create/repository/branch_with_unusual_name_spec.rb:22
2175  12) Package Maven request forwarding uses GitLab as a mirror of the central proxy
2176     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/378221
2177     # ./qa/specs/features/browser_ui/5_package/package_registry/maven/maven_group_level_spec.rb:288
2178  13) Package Maven request forwarding uses GitLab as a mirror of the central proxy
2179     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/378221
2180     # ./qa/specs/features/browser_ui/5_package/package_registry/maven/maven_project_level_spec.rb:216
2181  14) Create Add a directory in Web IDE when user adds a new empty directory shows successfully but not able to be committed
2182     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399544
2183     # ./qa/specs/features/browser_ui/3_create/web_ide_new/add_new_directory_in_web_ide_spec.rb:59
2184  15) Data Stores Search using Elasticsearch tests reindexing after push
2185     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385927
2186     # ./qa/specs/features/ee/browser_ui/9_data_stores/elasticsearch/elasticsearch_reindexing_spec.rb:45
2187  16) Data Stores Search using Elasticsearch tests reindexing after webIDE
2188     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/385927
2189     # ./qa/specs/features/ee/browser_ui/9_data_stores/elasticsearch/elasticsearch_reindexing_spec.rb:63
2190  17) Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a personal access token pushes image and deletes tag
2191     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2192     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2193  18) Package Self-managed Container Registry when tls is disabled using docker:20.10 and a personal access token pushes image and deletes tag
2194     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2195     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2196  19) Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a personal access token pushes image and deletes tag
2197     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2198     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2199  20) Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a project deploy token pushes image and deletes tag
2200     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2201     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2202  21) Package Self-managed Container Registry when tls is disabled using docker:19.03.12 and a ci job token pushes image and deletes tag
2203     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2204     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2205  22) Package Self-managed Container Registry when tls is disabled using docker:20.10 and a project deploy token pushes image and deletes tag
2206     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2207     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2208  23) Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a ci job token pushes image and deletes tag
2209     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2210     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2211  24) Package Self-managed Container Registry when tls is disabled using docker:18.09.9 and a project deploy token pushes image and deletes tag
2212     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2213     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2214  25) Package Self-managed Container Registry when tls is disabled using docker:20.10 and a ci job token pushes image and deletes tag
2215     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2216     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:137
2217  26) Package Self-managed Container Registry when tls is enabled pushes image and deletes tag
2218     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/399556
2219     # ./qa/specs/features/browser_ui/5_package/container_registry/container_registry_omnibus_spec.rb:196
2220  27) Verify Unlocking job artifacts across pipelines when latest pipeline failed unlocks job artifacts from failed pipelines, keeps job artifacts from latest successful pipeline
2221     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/266958
2222     # ./qa/specs/features/browser_ui/4_verify/ci_job_artifacts/unlocking_job_artifacts_across_pipelines_spec.rb:64
2223  28) Package PyPI Repository Geo replicates a published pypi package to the Geo secondary site
2224     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/325556
2225     # ./qa/specs/features/browser_ui/5_package/package_registry/pypi_repository_spec.rb:104
2226  29) Verify Cancelling merge request in merge train when system cancels the merge request creates a TODO task
2227     # In quarantine : https://gitlab.com/gitlab-org/gitlab/-/issues/324122
2228     # ./qa/specs/features/ee/browser_ui/4_verify/system_cancel_merge_request_in_merge_train_spec.rb:16
2229Finished in 0.45038 seconds (files took 4.11 seconds to load)
2230665 examples, 0 failures, 29 pending
2231Randomized with seed 29759
2232Saved to file: /builds/gitlab-org/gitlab/qa/tmp/test-metadata.json
2233$ cd ..
2234$ run_timed_command "./scripts/qa/testcases-check qa/tmp/test-metadata.json"
2235==> 'bundle exec bin/qa Test::Instance::All http://localhost:3000 --test-metadata-only' succeeded in 5 seconds.
2236$ ./scripts/qa/testcases-check qa/tmp/test-metadata.json
2237Analyzing testcase data...
2238No errors found.
2239==> './scripts/qa/testcases-check qa/tmp/test-metadata.json' succeeded in 0 seconds.
2240$ run_timed_command "./scripts/qa/quarantine-types-check qa/tmp/test-metadata.json"
2241$ ./scripts/qa/quarantine-types-check qa/tmp/test-metadata.json
2242Analyzing quarantined test data...
2243No errors found.
2244==> './scripts/qa/quarantine-types-check qa/tmp/test-metadata.json' succeeded in 1 seconds.
 2245  Uploading artifacts for successful job  
  00:03
2246Uploading artifacts...
2247qa/tmp/: found 4 matching artifact files and directories 
2248WARNING: Upload request redirected                  location=https://gitlab.com/api/v4/jobs/4016975562/artifacts?artifact_format=zip&artifact_type=archive&expire_in=31d new-url=https://gitlab.com
2249WARNING: Retrying...                                context=artifacts-uploader error=request redirected
2250Uploading artifacts as "archive" to coordinator... 201 Created  id=4016975562 responseStatus=201 Created token=64_SR4LC
 2251  Cleaning up project directory and file based variables  
  00:00
2252Job succeeded
Tags: gitlab-org
Job artifacts
The artifacts were removed 1 year ago
Commit da011c02 in !116002
Merge branch 'qe-quarantine-stale-flaky-specs' into 'master'
Related jobs

brakeman-sast
code_quality
docs code_quality
feature-flags-usage
haml-lint
haml-lint ee
ping-appsec-for-sast-findings
qa:metadata-lint
rubocop
secret_detection
semgrep-appsec-custom-rules
semgrep-sast
static-analysis 1/2
static-analysis 2/2
static-verification-with-database