QA failures on gstg-cny

Overview

• Environment: gstg-cny
• Coordinated pipeline: https://ops.gitlab.net/gitlab-org/release/tools/-/pipelines/4950872
• Auto-deploy package: 18.4.202509090506-240dbd58f51.91050b8018e

Pipeline:

• https://ops.gitlab.net/gitlab-org/quality/staging/-/jobs/20171011

1) Create Code Suggestions when code completion on SaaS with context behaves like indirect code completion returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:124[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:55:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  2) Create Code Suggestions when code completion on SaaS behaves like indirect code completion returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:120[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:55:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  3) Create Code Suggestions when code generation is requested on SaaS behaves like indirect code generation returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code generation" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:167[0m[0m
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
/builds/gitlab-org/quality/staging/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:46:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  4) Create Code Suggestions when code generation is requested when streaming on SaaS streams a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "code suggestions API using streaming" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:207[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:64:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  5) Create Code Suggestions when direct access on SaaS when direct connection returns a completion directly from AI gateway
     [31mFailure/Error: let(:direct_access) { Resource::CodeSuggestions::DirectAccess.fetch_direct_connection_details(token) }[0m
     [31m[0m
     [31mRuntimeError:[0m
     [31m  Unexpected status code 500[0m
     [31m[37mShared Example Group: "direct code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:296[0m[0m
     [36m# ./qa/resource/code_suggestions/direct_access.rb:14:in `fetch_direct_connection_details'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:34:in `block (3 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:326:in `get_direct_suggestion'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:232:in `block (5 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  6) Create Code Suggestions when direct access on SaaS when direct connection refuses a code generation request directly from AI gateway
     [31mFailure/Error: let(:direct_access) { Resource::CodeSuggestions::DirectAccess.fetch_direct_connection_details(token) }[0m
     [31m[0m
     [31mRuntimeError:[0m
     [31m  Unexpected status code 500[0m
     [31m[37mShared Example Group: "direct code generation" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:297[0m[0m
     [36m# ./qa/resource/code_suggestions/direct_access.rb:14:in `fetch_direct_connection_details'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:34:in `block (3 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:326:in `get_direct_suggestion'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:247:in `block (5 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

Finished in 13.83 seconds (files took 1.76 seconds to load)
[31m6 examples, 6 failures[0m

Failed examples:

[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:1:1:2:1:1]'[0m [36m# Create Code Suggestions when code completion on SaaS with context behaves like indirect code completion returns a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:1:1:1:1]'[0m [36m# Create Code Suggestions when code completion on SaaS behaves like indirect code completion returns a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:2:1:1:1]'[0m [36m# Create Code Suggestions when code generation is requested on SaaS behaves like indirect code generation returns a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:2:3:1:1]'[0m [36m# Create Code Suggestions when code generation is requested when streaming on SaaS streams a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:3:1:1]'[0m [36m# Create Code Suggestions when direct access on SaaS when direct connection returns a completion directly from AI gateway[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:3:1:2]'[0m [36m# Create Code Suggestions when direct access on SaaS when direct connection refuses a code generation request directly from AI gateway[0m

Pipeline:

• https://ops.gitlab.net/gitlab-org/quality/staging-canary/-/jobs/20171010

1) Create Code Suggestions when direct access on SaaS when direct connection returns a completion directly from AI gateway
     [31mFailure/Error: let(:direct_access) { Resource::CodeSuggestions::DirectAccess.fetch_direct_connection_details(token) }[0m
     [31m[0m
     [31mRuntimeError:[0m
     [31m  Unexpected status code 500[0m
     [31m[37mShared Example Group: "direct code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:296[0m[0m
     [36m# ./qa/resource/code_suggestions/direct_access.rb:14:in `fetch_direct_connection_details'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:34:in `block (3 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:326:in `get_direct_suggestion'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:232:in `block (5 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  2) Create Code Suggestions when direct access on SaaS when direct connection refuses a code generation request directly from AI gateway
     [31mFailure/Error: let(:direct_access) { Resource::CodeSuggestions::DirectAccess.fetch_direct_connection_details(token) }[0m
     [31m[0m
     [31mRuntimeError:[0m
     [31m  Unexpected status code 500[0m
     [31m[37mShared Example Group: "direct code generation" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:297[0m[0m
     [36m# ./qa/resource/code_suggestions/direct_access.rb:14:in `fetch_direct_connection_details'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:34:in `block (3 levels) in <module:QA>'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:326:in `get_direct_suggestion'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:247:in `block (5 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  3) Create Code Suggestions when code generation is requested on SaaS behaves like indirect code generation returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
/builds/gitlab-org/quality/staging-canary/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
/builds/gitlab-org/quality/staging-canary/.gems/bin/gitlab-qa: Command `docker run -t --rm --net=bridge --env QA_CAN_TEST_GIT_PROTOCOL_V2="$QA_CAN_TEST_GIT_PROTOCOL_V2" ...` failed! [31m✘[0m (Gitlab::QA::Support::ShellCommand::StatusError)
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code generation" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:167[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:46:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  4) Create Code Suggestions when code generation is requested when streaming on SaaS streams a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "code suggestions API using streaming" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:207[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:64:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  5) Create Code Suggestions when code completion on SaaS behaves like indirect code completion returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:120[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:55:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

  6) Create Code Suggestions when code completion on SaaS with context behaves like indirect code completion returns a suggestion
     [31mFailure/Error:[0m
     [31m  expect(response.code).to eq(expected_code),[0m
     [31m    "Expected (#{expected_code}), request returned (#{response.code}): `#{response}`"[0m
     [31m[0m
     [31m  Expected (200), request returned (500): `{"message":"500 Internal Server Error"}`[0m
     [31m[37mShared Example Group: "indirect code completion" called from ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:124[0m[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:346:in `expect_status_code'[0m
     [36m# ./qa/specs/features/ee/api/3_create/code_suggestions_spec.rb:55:in `block (4 levels) in <module:QA>'[0m
     [36m# /home/gitlab/spec/support/fast_quarantine.rb:22:in `block (2 levels) in <top (required)>'[0m
     [36m# ./qa/specs/runner.rb:124:in `run_rspec'[0m
     [36m# ./qa/specs/runner.rb:32:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/template.rb:63:in `perform'[0m
     [36m# ./qa/scenario/template.rb:10:in `block in perform'[0m
     [36m# ./qa/scenario/template.rb:8:in `perform'[0m
     [36m# ./qa/scenario/bootable.rb:52:in `launch!'[0m

Finished in 13.9 seconds (files took 1.64 seconds to load)
[31m6 examples, 6 failures[0m

Failed examples:

[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:3:1:1]'[0m [36m# Create Code Suggestions when direct access on SaaS when direct connection returns a completion directly from AI gateway[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:3:1:2]'[0m [36m# Create Code Suggestions when direct access on SaaS when direct connection refuses a code generation request directly from AI gateway[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:2:1:1:1]'[0m [36m# Create Code Suggestions when code generation is requested on SaaS behaves like indirect code generation returns a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:2:3:1:1]'[0m [36m# Create Code Suggestions when code generation is requested when streaming on SaaS streams a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:1:1:1:1]'[0m [36m# Create Code Suggestions when code completion on SaaS behaves like indirect code completion returns a suggestion[0m
[31mrspec './qa/specs/features/ee/api/3_create/code_suggestions_spec.rb[1:1:1:1:2:1:1]'[0m [36m# Create Code Suggestions when code completion on SaaS with context behaves like indirect code completion returns a suggestion[0m