QA failures on gstg-cny

Overview

  • Environment: gstg-cny
  • Coordinated pipeline: https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/3347376
  • Auto-deploy package: 17.1.202406041000-3618f5171e9.16f34009562

Pipeline:

  • https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/14179741
1) Govern Group Level Scan Execution Policy does not take effect when pipeline is run on non default branch
     [31mFailure/Error: [0mcreate([33m:project[0m, [33m:with_readme[0m, [35mgroup[0m: group, [35mname[0m: [31m[1;31m'[0m[31mproject-with-scan-execution-policy[1;31m'[0m[31m[0m)[0m
     [31m[0m
     [31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
     [31m  Fabrication of QA::Resource::Project using the API failed (502) with `<!DOCTYPE html>[0m
     [31m  <html>[0m
     [31m  <head>[0m
     [31m    <meta content="width=device-width, initial-scale=1, maximum-scale=1" name="viewport">[0m
     [31m    <title>500 Error - GitLab</title>[0m
     [31m    <style>body{align-items:center;color:#666;display:flex;flex-direction:column;font-family:Helvetica Neue,Helvetica,Arial,sans-serif;font-size:14px;justify-content:center;margin:auto;text-align:center}hr{border:0;border-bottom:1px solid #fff;border-top:1px solid #eee;margin:18px auto;max-width:800px}img{max-width:40vw}.container{margin:auto 20px}.cferror_details{list-style-type:none}.cf-error-details h1{color:#456;font-size:20px;font-weight:400;line-height:28px}</style>[0m
     [31m[0m
     [31m[0m
     [31m  </head>[0m
     [31m[0m
     [31m  <body>[0m
     [31m    <h1>[0m
     [31m      <img src="data:image/svg+xml;base64,PHN2ZyB3aWR0aD0iMjAwIiBoZWlnaHQ9IjE5MiIgdmlld0JveD0iMCAwIDI1IDI0IiBmaWxsPSJub25lIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPgogIDxwYXRoIGQ9Im0yNC41MDcgOS41LS4wMzQtLjA5TDIxLjA4Mi41NjJhLjg5Ni44OTYgMCAwIDAtMS42OTQuMDkxbC0yLjI5IDcuMDFINy44MjVMNS41MzUuNjUzYS44OTguODk4IDAgMCAwLTEuNjk0LS4wOUwuNDUxIDkuNDExLjQxNiA5LjVhNi4yOTcgNi4yOTcgMCAwIDAgMi4wOSA3LjI3OGwuMDEyLjAxLjAzLjAyMiA1LjE2IDMuODY3IDIuNTYgMS45MzUgMS41NTQgMS4xNzZhMS4wNTEgMS4wNTEgMCAwIDAgMS4yNjggMGwxLjU1NS0xLjE3NiAyLjU2LTEuOTM1IDUuMTk3LTMuODkuMDE0LS4wMUE2LjI5NyA2LjI5NyAwIDAgMCAyNC41MDcgOS41WiIKICAgICAgICBmaWxsPSIjRTI0MzI5Ii8+CiAgPHBhdGggZD0ibTI0LjUwNyA5LjUtLjAzNC0uMDlhMTEuNDQgMTEuNDQgMCAwIDAtNC41NiAyLjA1MWwtNy40NDcgNS42MzIgNC43NDIgMy41ODQgNS4xOTctMy44OS4wMTQtLjAxQTYuMjk3IDYuMjk3IDAgMCAwIDI0LjUwNyA5LjVaIgogICAgICAgIGZpbGw9IiNGQzZEMjYiLz4KICA8cGF0aCBkPSJtNy43MDcgMjAuNjc3IDIuNTYgMS45MzUgMS41NTUgMS4xNzZhMS4wNTEgMS4wNTEgMCAwIDAgMS4yNjggMGwxLjU1NS0xLjE3NiAyLjU2LTEuOTM1LTQuNzQzLTMuNTg0LTQuNzU1IDMuNTg0WiIKICAgICAgICBmaWxsPSIjRkNBMzI2Ii8+CiAgPHBhdGggZD0iTTUuMDEgMTEuNDYxYTExLjQzIDExLjQzIDAgMCAwLTQuNTYtMi4wNUwuNDE2IDkuNWE2LjI5NyA2LjI5NyAwIDAgMCAyLjA5IDcuMjc4bC4wMTIuMDEuMDMuMDIyIDUuMTYgMy44NjcgNC43NDUtMy41ODQtNy40NDQtNS42MzJaIgogICAgICAgIGZpbGw9IiNGQzZEMjYiLz4KPC9zdmc+Cg==" alt="GitLab" /><br />[0m
     [31m    </h1>[0m
     [31m    <div class="container">[0m
     [31m      <div class="cf-error-details cf-error-502">[0m
     [31m    <h1>Bad gateway</h1>[0m
     [31m    <p>The web server reported a bad gateway error.</p>[0m
     [31m    <ul>[0m
     [31m      <li>Ray ID: 88e7b1d09f68adc9</li>[0m
     [31m      <li>Your IP address: 34.148.178.194</li>[0m
     [31m      <li>Error reference number: 502</li>[0m
     [31m      <li>Cloudflare Location: Atlanta</li>[0m
     [31m    </ul>[0m
     [31m  </div>[0m
     [31m[0m
     [31m      <hr />[0m
     [31m      <p>Please see our <a href="https://status.gitlab.com">status page</a> for more information.</p>[0m
     [31m    </div>[0m
     [31m  </body>[0m
     [31m  </html>[0m
     [31m  `.[0m
     [36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
     [36m# ./qa/resource/api_fabricator.rb:107:in `api_post'[0m
     [36m# ./qa/resource/api_fabricator.rb:29:in `fabricate_via_api!'[0m
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! \e[31m✘\e[0m (Gitlab::QA::Support::ShellCommand::StatusError)
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! \e[31m✘\e[0m (Gitlab::QA::Support::ShellCommand::StatusError)
     [36m# ./qa/resource/project.rb:127:in `rescue in fabricate_via_api!'[0m
     [36m# ./qa/resource/project.rb:124:in `fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:73:in `block (2 levels) in fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:108:in `log_and_record_fabrication'[0m
     [36m# ./qa/resource/base.rb:73:in `block in fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:98:in `do_fabricate!'[0m
     [36m# ./qa/resource/base.rb:72:in `fabricate_via_api!'[0m
     [36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/browser_ui/10_govern/scan_execution_policy_vulnerabilities_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:66:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:35:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
     [36m# ------------------[0m
     [36m# --- Caused by: ---[0m
     [36m# QA::Resource::Errors::ResourceNotFoundError:[0m
     [36m#   Resource at https://staging.gitlab.com/api/v4/projects/gitlab-qa-sandbox-group-3%2Fscan-execution-policy-group-d9c6d06e%2Fproject-with-scan-execution-policy-45dd07d92e321d73?private_token=[MASKED] could not be found (404): `{"message":"404 Project Not Found"}`.[0m
     [36m#   Correlation Id: ce07978ab8d8a548a6a4e41b01d821af[0m
     [36m#   Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gstg&project=3&query=correlation_id%3A%22ce07978ab8d8a548a6a4e41b01d821af%22[0m
     [36m#   Kibana - Discover Url: https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%20ce07978ab8d8a548a6a4e41b01d821af%27%29%29&_g=%28time%3A%28from%3A%272024-06-03T11:48:33.954Z%27%2Cto%3A%272024-06-04T11:48:33.954Z%27%29%29[0m
     [36m#   Kibana - Dashboard Url: https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%3A%28from:%272024-06-03T11:48:33.954Z%27%2Cto%3A%272024-06-04T11:48:33.954Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%27ce07978ab8d8a548a6a4e41b01d821af%27%29%29%29%29%29[0m
     [36m#   ./qa/resource/api_fabricator.rb:97:in `api_get_from'[0m

Finished in 48.14 seconds (files took 3.59 seconds to load)
[31m1 example, 1 failure[0m

Failed examples:

[31mrspec ./qa/specs/features/ee/browser_ui/10_govern/scan_execution_policy_vulnerabilities_spec.rb:70[0m [36m# Govern Group Level Scan Execution Policy does not take effect when pipeline is run on non default branch[0m

Pipeline:

  • https://ops.gitlab.net/gitlab-org/quality/staging-canary/-/jobs/14179740
1) Govern Group Level Scan Execution Policy takes effect when pipeline is run on the main branch
     [31mFailure/Error:[0m
     [31m  [0mcreate([33m:commit[0m,[0m
     [31m    [0m[35mproject[0m: project,[0m
     [31m    [0m[35mstart_branch[0m: project.default_branch,[0m
     [31m    [0m[35mbranch[0m: branch_name,[0m
     [31m    [0m[35mcommit_message[0m: [31m[1;31m"[0m[31mCommit files to #{branch_name}[0m[31m branch[1;31m"[0m[31m[0m,[0m
     [31m    [0m[35mactions[0m: [ci_file, test_file])[0m
     [31m[0m
     [31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
     [31m  Fabrication of QA::Resource::Repository::Commit using the API failed (400) with `{"message":"13:update reference: running pre-receive hooks: GitLab: Internal API error (502)."}`.[0m
     [31m  Correlation Id: a245a9a79a7863cd3711ae09bcb747b4[0m
     [31m  Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gstg&project=3&query=correlation_id%3A%22a245a9a79a7863cd3711ae09bcb747b4%22[0m
     [31m  Kibana - Discover Url: https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%20a245a9a79a7863cd3711ae09bcb747b4%27%29%29&_g=%28time%3A%28from%3A%272024-06-03T11:48:21.996Z%27%2Cto%3A%272024-06-04T11:48:21.996Z%27%29%29[0m
     [31m  Kibana - Dashboard Url: https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%3A%28from:%272024-06-03T11:48:21.996Z%27%2Cto%3A%272024-06-04T11:48:21.996Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%27a245a9a79a7863cd3711ae09bcb747b4%27%29%29%29%29%29[0m
     [36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
     [36m# ./qa/resource/api_fabricator.rb:107:in `api_post'[0m
     [36m# ./qa/resource/api_fabricator.rb:29:in `fabricate_via_api!'[0m
     [36m# ./qa/resource/repository/commit.rb:28:in `fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:73:in `block (2 levels) in fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:108:in `log_and_record_fabrication'[0m
     [36m# ./qa/resource/base.rb:73:in `block in fabricate_via_api!'[0m
     [36m# ./qa/resource/base.rb:98:in `do_fabricate!'[0m
     [36m# ./qa/resource/base.rb:72:in `fabricate_via_api!'[0m
     [36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/browser_ui/10_govern/scan_execution_policy_vulnerabilities_spec.rb:127:in `create_commit'[0m
     [36m# ./qa/specs/features/ee/browser_ui/10_govern/scan_execution_policy_vulnerabilities_spec.rb:64:in `block (3 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:66:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:35:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

Finished in 1 minute 39.48 seconds (files took 2.49 seconds to load)
[31m2 examples, 1 failure[0m

Failed examples:

[31mrspec ./qa/specs/features/ee/browser_ui/10_govern/scan_execution_policy_vulnerabilities_spec.rb:57[0m [36m# Govern Group Level Scan Execution Policy takes effect when pipeline is run on the main branch[0m
  • https://ops.gitlab.net/gitlab-org/quality/staging-canary/-/jobs/14179733
1) Verify Pipeline with raw variables in YAML expands variables according to expand: true/false
     [31mFailure/Error: [0m[1;34;4mFlow[0m::[1;34;4mPipeline[0m.visit_latest_pipeline([35mstatus[0m: [31m[1;31m'[0m[31mPassed[1;31m'[0m[31m[0m)[0m
     [31m[0m
     [31mQA::Support::Repeater::WaitExceededError:[0m
     [31m  Wait for latest pipeline failed after 60 seconds[0m
     [36m# ./qa/support/repeater.rb:74:in `repeat_until'[0m
     [36m# ./qa/support/waiter.rb:20:in `wait_until'[0m
     [36m# ./qa/page/base.rb:76:in `wait_until'[0m
     [36m# ./qa/page/project/pipeline/index.rb:37:in `wait_for_latest_pipeline'[0m
     [36m# ./qa/flow/pipeline.rb:15:in `block in visit_latest_pipeline'[0m
     [36m# ./qa/scenario/actable.rb:16:in `perform'[0m
     [36m# ./qa/flow/pipeline.rb:13:in `visit_latest_pipeline'[0m
     [36m# ./qa/specs/features/browser_ui/4_verify/ci_variable/raw_variables_defined_in_yaml_spec.rb:62:in `block (3 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:66:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:35:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

Finished in 1 minute 29.06 seconds (files took 2.81 seconds to load)
[31m1 example, 1 failure[0m

Failed examples:

[31mrspec ./qa/specs/features/browser_ui/4_verify/ci_variable/raw_variables_defined_in_yaml_spec.rb:76[0m [36m# Verify Pipeline with raw variables in YAML expands variables according to expand: true/false[0m
Assignee Loading
Time tracking Loading