QA failures on gstg-cny
Overview
- Environment: gstg-cny
- Coordinated pipeline: https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/5273543
- Auto-deploy package: 18.7.202512050306-51023ea2579.48079c4b845
Pipeline:
1) Create SSH key support pushes multiple branches and tags together
[31mFailure/Error: let(:project) { create(:project, name: 'ssh-tests') }[0m
[31m[0m
[31mQA::Resource::Errors::ResourceFabricationFailedError:[0m
[31m Fabrication of QA::Resource::Project using the API failed (400) with `{"message":{"base":["14:connections to all backends failing; last error: UNKNOWN: ipv4:10.224.13.54:8075: Failed to connect to remote host: Connection refused. debug_error_string:{UNKNOWN:Error received from peer {grpc_status:14, grpc_message:\"connections to all backends failing; last error: UNKNOWN: ipv4:10.224.13.54:8075: Failed to connect to remote host: Connection refused\"}}"]}}`.[0m
[31m Correlation Id: 9a91486913f2450b-ATL[0m
[31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gstg&project=3&query=correlation_id%3A%229a91486913f2450b-ATL%22[0m
[31m Kibana - Discover Url: https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209a91486913f2450b-ATL%27%29%29&_g=%28time%3A%28from%3A%272025-12-04T05:53:26.200Z%27%2Cto%3A%272025-12-05T05:53:26.200Z%27%29%29[0m
[31m Kibana - Dashboard Url: https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%3A%28from:%272025-12-04T05:53:26.200Z%27%2Cto%3A%272025-12-05T05:53:26.200Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279a91486913f2450b-ATL%27%29%29%29%29%29[0m
[36m# ./qa/resource/api_fabricator.rb:134:in `api_post_to'[0m
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_METRICS_DB="$GLCI_CLICKHOUSE_METRICS_DB" --...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env GLCI_CLICKHOUSE_METRICS_DB="$GLCI_CLICKHOUSE_METRICS_DB" --...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
[36m# ./qa/resource/api_fabricator.rb:108:in `api_post'[0m
[36m# ./qa/resource/api_fabricator.rb:27:in `fabricate_via_api!'[0m
[36m# ./qa/resource/project.rb:126:in `rescue in fabricate_via_api!'[0m
[36m# ./qa/resource/project.rb:123:in `fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
[36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
[36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
[36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
[36m# ./qa/specs/features/browser_ui/3_create/repository/push_over_ssh_spec.rb:9:in `block (3 levels) in <module:QA>'[0m
[36m# ./qa/specs/features/browser_ui/3_create/repository/push_over_ssh_spec.rb:39:in `block (4 levels) in <module:QA>'[0m
[36m# ./qa/scenario/actable.rb:16:in `perform'[0m
[36m# ./qa/git/repository.rb:35:in `block (2 levels) in perform'[0m
[36m# ./qa/git/repository.rb:35:in `chdir'[0m
[36m# ./qa/git/repository.rb:35:in `block in perform'[0m
[36m# ./qa/git/repository.rb:34:in `perform'[0m
[36m# ./qa/specs/features/browser_ui/3_create/repository/push_over_ssh_spec.rb:38:in `block (3 levels) in <module:QA>'[0m
[36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
[36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
[36m# ./qa/specs/runner.rb:32:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/template.rb:63:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
[36m# ------------------[0m
[36m# --- Caused by: ---[0m
[36m# QA::Resource::Errors::ResourceNotFoundError:[0m
[36m# Resource at https://staging.gitlab.com/api/v4/projects/gitlab-e2e-sandbox-group-5%2Fe2e-test-2025-12-05-05-53-16-11065d6f833666cc%2Fssh-tests-8dec91afbeae6ff8?private_token=[MASKED] could not be found (404): `{"message":"404 Project Not Found"}`.[0m
[36m# Correlation Id: 9a91485d54b9dd24-ATL[0m
[36m# Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gstg&project=3&query=correlation_id%3A%229a91485d54b9dd24-ATL%22[0m
[36m# Kibana - Discover Url: https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209a91485d54b9dd24-ATL%27%29%29&_g=%28time%3A%28from%3A%272025-12-04T05:53:23.274Z%27%2Cto%3A%272025-12-05T05:53:23.274Z%27%29%29[0m
[36m# Kibana - Dashboard Url: https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%3A%28from:%272025-12-04T05:53:23.274Z%27%2Cto%3A%272025-12-05T05:53:23.274Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279a91485d54b9dd24-ATL%27%29%29%29%29%29[0m
[36m# ./qa/resource/api_fabricator.rb:93:in `api_get_from'[0m
Finished in 1 minute 7.37 seconds (files took 1.46 seconds to load)
[31m2 examples, 1 failure[0m
Failed examples:
[31mrspec ./qa/specs/features/browser_ui/3_create/repository/push_over_ssh_spec.rb:34[0m [36m# Create SSH key support pushes multiple branches and tags together[0m
Pipeline:
1) Create Merge request push options removes labels on subsequent push
[31mFailure/Error:[0m
[31m create(:branch, name: "push-options-test-target-#{SecureRandom.hex(8)}", project: project,[0m
[31m ref: project.default_branch)[0m
[31m[0m
[31mQA::Resource::Errors::InternalServerError:[0m
[31m Failed to GET https://staging.gitlab.com/api/v4/projects/18740923/repository/branches/push-options-test-target-83c4346ace4bc07e?private_token=[MASKED] - (500): `{"message":"500 Internal Server Error"}`.[0m
[31m Correlation Id: 9a9148fbd53f4f98-ATL[0m
[31m Sentry Url: https://new-sentry.gitlab.net/organizations/gitlab/issues/?environment=gstg&project=3&query=correlation_id%3A%229a9148fbd53f4f98-ATL%22[0m
[31m Kibana - Discover Url: https://nonprod-log.gitlab.net/app/discover#/?_a=%28index:%27ed942d00-5186-11ea-ad8a-f3610a492295%27%2Cquery%3A%28language%3Akuery%2Cquery%3A%27json.correlation_id%20%3A%209a9148fbd53f4f98-ATL%27%29%29&_g=%28time%3A%28from%3A%272025-12-04T05:53:49.851Z%27%2Cto%3A%272025-12-05T05:53:49.851Z%27%29%29[0m
[31m Kibana - Dashboard Url: https://nonprod-log.gitlab.net/app/dashboards#/view/b74dc030-6f56-11ed-9af2-6131f0ee4ce6?_g=%28time%3A%28from:%272025-12-04T05:53:49.851Z%27%2Cto%3A%272025-12-05T05:53:49.851Z%27%29%29&_a=%28filters%3A%21%28%28query%3A%28match_phrase%3A%28json.correlation_id%3A%279a9148fbd53f4f98-ATL%27%29%29%29%29%29[0m
[36m# ./qa/resource/api_fabricator.rb:98:in `api_get_from'[0m
[36m# ./qa/resource/api_fabricator.rb:76:in `api_get'[0m
[36m# ./qa/resource/repository/branch.rb:26:in `fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:74:in `block (2 levels) in fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:117:in `log_and_record_fabrication'[0m
[36m# ./qa/resource/base.rb:74:in `block in fabricate_via_api!'[0m
[36m# ./qa/resource/base.rb:107:in `do_fabricate!'[0m
[36m# ./qa/resource/base.rb:73:in `fabricate_via_api!'[0m
[36m# ./qa/factories/_shared.rb:6:in `block (2 levels) in <module:QA>'[0m
[36m# ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:17:in `block (3 levels) in <module:QA>'[0m
[36m# ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:30:in `block (4 levels) in <module:QA>'[0m
[36m# ./qa/resource/base.rb:105:in `do_fabricate!'[0m
[36m# ./qa/resource/base.rb:59:in `fabricate_via_browser_ui!'[0m
[36m# ./qa/resource/base.rb:51:in `rescue in fabricate!'[0m
[36m# ./qa/resource/base.rb:43:in `fabricate!'[0m
[36m# ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:22:in `block (3 levels) in <module:QA>'[0m
[36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
[36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
[36m# ./qa/specs/runner.rb:32:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/template.rb:63:in `perform'[0m
[36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
[36m# ./qa/scenario/template.rb:8:in `perform'[0m
[36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m
[36m# ------------------[0m
[36m# --- Caused by: ---[0m
[36m# NotImplementedError:[0m
[36m# NotImplementedError[0m
[36m# ./qa/resource/base.rb:71:in `fabricate_via_api!'[0m
Finished in 33.98 seconds (files took 1.46 seconds to load)
[31m2 examples, 1 failure[0m
Failed examples:
[31mrspec ./qa/specs/features/api/3_create/merge_request/push_options_spec.rb:48[0m [36m# Create Merge request push options removes labels on subsequent push[0m