Skip to content
Snippets Groups Projects

ai-gateway-no-add-on

Failed Started by
🤖 GitLab Bot 🤖
@gitlab-bot
1Running with gitlab-runner 16.3.0~beta.108.g2b6048b4 (2b6048b4)
2 on 1-blue.qa-runners.runners-manager.gitlab.com/dind xNFYsSa9Z, system ID: s_3f9d4f15398b
3 feature flags: FF_USE_IMPROVED_URL_MASKING:true
4 Resolving secrets 00:00
5 Preparing the "docker+machine" executor 00:43
6Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-docker-24.0.5 ...
7Starting service docker:24.0.5-dind ...
8Pulling docker image docker:24.0.5-dind ...
9Using docker image sha256:7015f2c475d511a251955877c2862016a4042512ba625ed905e69202f87e1a21 for docker:24.0.5-dind with digest docker@sha256:3c6e4dca7a63c9a32a4e00da40461ce067f255987ccc9721cf18ffa087bcd1ef ...
10Waiting for services to be up and running (timeout 30 seconds)...
11Authenticating with credentials from job payload (GitLab Registry)
12Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-docker-24.0.5 ...
13Using docker image sha256:32e051771f994ccba4dc5843562338378708465b09486ad3d98412d2bc34e23e for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-docker-24.0.5 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0@sha256:a7205ef2cd3e1fe5f2d2d9f42c4d014773358d3fa37146db2998753feac8cee5 ...
14 Preparing environment 00:20
15Running on runner-xnfyssa9z-project-278964-concurrent-0 via runner-xnfyssa9z-qa-runners-1712088599-2db484fd...
16 Getting source from Git repository 00:22
17Fetching changes with git depth set to 20...
18Initialized empty Git repository in /builds/gitlab-org/gitlab/.git/
19Created fresh repository.
20remote: Enumerating objects: 152406, done.
21remote: Counting objects: 100% (152406/152406), done.
22remote: Compressing objects: 100% (106043/106043), done.
23remote: Total 152406 (delta 67327), reused 98854 (delta 40181), pack-reused 0 (from 0)
24Receiving objects: 100% (152406/152406), 129.99 MiB | 43.51 MiB/s, done.
25Resolving deltas: 100% (67327/67327), done.
26From https://gitlab.com/gitlab-org/gitlab
27 * [new ref] refs/pipelines/1237345855 -> refs/pipelines/1237345855
28 * [new branch] ruby3_0 -> origin/ruby3_0
29Checking out 2abba690 as detached HEAD (ref is ruby3_0)...
30Skipping Git submodules setup
31 Restoring cache 00:01
32Checking cache for qa-e2e-ruby-3.0-82e59c1c3ff29fb9615a8d170db176d3-17...
33WARNING: file does not exist
34Failed to extract cache
35 Downloading artifacts 00:00
36Downloading artifacts for download-knapsack-report (6531944601)...
37Downloading artifacts from coordinator... ok host=storage.googleapis.com id=6531944601 responseStatus=200 OK token=glcbt-65
38 Executing "step_script" stage of the job script 02:00
39Using docker image sha256:32e051771f994ccba4dc5843562338378708465b09486ad3d98412d2bc34e23e for registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0:bundler-2.3-docker-24.0.5 with digest registry.gitlab.com/gitlab-org/gitlab-build-images/debian-bullseye-ruby-3.0@sha256:a7205ef2cd3e1fe5f2d2d9f42c4d014773358d3fa37146db2998753feac8cee5 ...
40$ export QA_EE_ACTIVATION_CODE=$QA_EE_ACTIVATION_CODE_NO_ADD_ON
41$ echo "SUITE_RAN=true" > $QA_SUITE_STATUS_ENV_FILE
42$ export BUNDLE_PREFIX=$([ "$RUN_WITH_BUNDLE" != "true" ] || echo "bundle exec")
43$ if [ "$RUN_WITH_BUNDLE" == "true" ]; then # collapsed multi-line command
44Fetching gem metadata from https://rubygems.org/.......
45Fetching rake 13.1.0
46Installing rake 13.1.0
47Fetching concurrent-ruby 1.2.3
48Fetching minitest 5.22.2
49Fetching builder 3.2.4
50Fetching erubi 1.12.0
51Fetching racc 1.7.3
52Fetching rack 2.2.3.1
53Fetching crass 1.0.6
54Fetching public_suffix 5.0.4
55Installing crass 1.0.6
56Installing erubi 1.12.0
57Installing builder 3.2.4
58Fetching http-accept 1.7.0
59Installing racc 1.7.3 with native extensions
60Installing minitest 5.22.2
61Installing public_suffix 5.0.4
62Fetching domain_name 0.6.20240107
63Installing rack 2.2.3.1
64Installing http-accept 1.7.0
65Fetching mime-types-data 3.2023.0218.1
66Fetching netrc 0.11.0
67Installing concurrent-ruby 1.2.3
68Fetching rspec-support 3.13.0
69Fetching diff-lcs 1.3
70Installing netrc 0.11.0
71Installing domain_name 0.6.20240107
72Installing rspec-support 3.13.0
73Fetching require_all 3.0.0
74Installing diff-lcs 1.3
75Installing mime-types-data 3.2023.0218.1
76Installing require_all 3.0.0
77Fetching systemu 2.6.5
78Fetching sexp_processor 4.17.1
79Fetching sync 0.5.0
80Fetching ast 2.4.2
81Fetching base64 0.2.0
82Installing systemu 2.6.5
83Fetching debug_inspector 1.1.0
84Installing sync 0.5.0
85Installing sexp_processor 4.17.1
86Installing ast 2.4.2
87Fetching byebug 11.1.3
88Installing base64 0.2.0
89Fetching matrix 0.4.2
90Fetching mini_mime 1.1.5
91Installing debug_inspector 1.1.0 with native extensions
92Fetching regexp_parser 2.1.1
93Fetching colorize 0.8.1
94Fetching rubyzip 2.3.2
95Installing mini_mime 1.1.5
96Installing colorize 0.8.1
97Fetching websocket 1.2.10
98Installing matrix 0.4.2
99Installing byebug 11.1.3 with native extensions
100Fetching coderay 1.1.2
101Fetching declarative 0.0.20
102Installing rubyzip 2.3.2
103Installing regexp_parser 2.1.1
104Installing websocket 1.2.10
105Installing declarative 0.0.20
106Installing coderay 1.1.2
107Fetching excon 0.92.4
108Fetching faraday-net_http 3.0.0
109Fetching ruby2_keywords 0.0.5
110Fetching ffi 1.16.3
111Fetching formatador 0.3.0
112Installing faraday-net_http 3.0.0
113Installing ruby2_keywords 0.0.5
114Installing excon 0.92.4
115Fetching multi_json 1.15.0
116Fetching jwt 2.5.0
117Fetching memoist 0.16.2
118Installing formatador 0.3.0
119Installing multi_json 1.15.0
120Fetching os 1.1.4
121Installing memoist 0.16.2
122Installing jwt 2.5.0
123Fetching httpclient 2.8.3
124Fetching trailblazer-option 0.1.2
125Installing os 1.1.4
126Fetching uber 0.1.0
127Fetching retriable 3.1.2
128Fetching webrick 1.7.0
129Installing trailblazer-option 0.1.2
130Fetching multi_xml 0.6.0
131Installing uber 0.1.0
132Installing retriable 3.1.2
133Fetching unicode-display_width 2.5.0
134Installing webrick 1.7.0
135Fetching http-form_data 2.3.0
136Installing multi_xml 0.6.0
137Fetching parallel 1.24.0
138Fetching rainbow 3.1.1
139Installing unicode-display_width 2.5.0
140Installing httpclient 2.8.3
141Fetching table_print 1.5.7
142Installing http-form_data 2.3.0
143Installing parallel 1.24.0
144Fetching zeitwerk 2.6.13
145Installing rainbow 3.1.1
146Fetching influxdb-client 3.1.0
147Installing ffi 1.16.3 with native extensions
148Installing table_print 1.5.7
149Fetching knapsack 4.0.0
150Fetching method_source 1.0.0
151Installing zeitwerk 2.6.13
152Installing influxdb-client 3.1.0
153Fetching rotp 6.3.0
154Installing method_source 1.0.0
155Fetching ruby-debug-ide 0.7.3
156Fetching slack-notifier 2.4.0
157Fetching warning 1.3.0
158Installing rotp 6.3.0
159Fetching addressable 2.8.6
160Installing ruby-debug-ide 0.7.3 with native extensions
161Installing slack-notifier 2.4.0
162Installing warning 1.3.0
163Fetching http-cookie 1.0.5
164Fetching rspec-core 3.13.0
165Fetching rack-test 1.1.0
166Installing addressable 2.8.6
167Installing knapsack 4.0.0
168Installing rack-test 1.1.0
169Installing http-cookie 1.0.5
170Fetching rspec-expectations 3.13.0
171Fetching rspec-mocks 3.13.0
172Installing rspec-core 3.13.0
173Fetching mime-types 3.4.1
174Installing rspec-expectations 3.13.0
175Installing rspec-mocks 3.13.0
176Installing mime-types 3.4.1
177Fetching macaddr 1.7.2
178Fetching tins 1.32.1
179Fetching i18n 1.14.1
180Installing macaddr 1.7.2
181Fetching tzinfo 2.0.6
182Fetching nokogiri 1.16.3 (x86_64-linux)
183Fetching ruby_parser 3.21.0
184Installing i18n 1.14.1
185Installing tzinfo 2.0.6
186Installing tins 1.32.1
187Fetching parser 3.3.0.5
188Fetching binding_of_caller 1.0.0
189Installing ruby_parser 3.21.0
190Installing binding_of_caller 1.0.0
191Fetching selenium-webdriver 4.19.0
192Fetching faraday 2.5.2
193Installing parser 3.3.0.5
194Fetching representable 3.2.0
195Fetching httparty 0.21.0
196Installing faraday 2.5.2
197Installing httparty 0.21.0
198Installing representable 3.2.0
199Fetching terminal-table 3.0.2
200Fetching parallel_tests 4.4.0
201Installing terminal-table 3.0.2
202Fetching pry 0.14.1
203Installing parallel_tests 4.4.0
204Fetching launchy 2.5.0
205Fetching rspec-retry 0.6.2
206Fetching rspec_junit_formatter 0.6.0
207Installing nokogiri 1.16.3 (x86_64-linux)
208Installing rspec-retry 0.6.2
209Installing launchy 2.5.0
210Installing rspec_junit_formatter 0.6.0
211Fetching rest-client 2.1.0
212Installing pry 0.14.1
213Fetching fog-core 2.1.0
214Fetching rspec 3.13.0
215Installing rspec 3.13.0
216Installing fog-core 2.1.0
217Installing rest-client 2.1.0
218Fetching uuid 2.3.9
219Installing uuid 2.3.9
220Fetching faker 3.3.1
221Fetching activesupport 7.0.8.1
222Fetching protocol 2.0.0
223Fetching faraday-retry 2.2.0
224Installing protocol 2.0.0
225Installing faraday-retry 2.2.0
226Fetching signet 0.17.0
227Fetching google-cloud-env 1.6.0
228Installing activesupport 7.0.8.1
229Installing signet 0.17.0
230Installing google-cloud-env 1.6.0
231Fetching sawyer 0.9.2
232Fetching gitlab 4.19.0
233Installing sawyer 0.9.2
234Installing gitlab 4.19.0
235Fetching unparser 0.6.5
236Installing faker 3.3.1
237Installing unparser 0.6.5
238Fetching allure-ruby-commons 2.24.2
239Installing allure-ruby-commons 2.24.2
240Fetching pry-byebug 3.10.1
241Fetching fog-json 1.2.0
242Fetching mize 0.4.1
243Fetching googleauth 1.2.0
244Installing pry-byebug 3.10.1
245Installing fog-json 1.2.0
246Installing mize 0.4.1
247Installing googleauth 1.2.0
248Fetching octokit 8.1.0
249Fetching proc_to_ast 0.1.0
250Fetching allure-rspec 2.24.2
251Fetching airborne 0.3.7
252Installing octokit 8.1.0
253Installing proc_to_ast 0.1.0
254Installing allure-rspec 2.24.2
255Fetching deprecation_toolkit 2.2.0
256Fetching factory_bot 6.3.0
257Installing airborne 0.3.7
258Installing deprecation_toolkit 2.2.0
259Installing factory_bot 6.3.0
260Installing selenium-webdriver 4.19.0
261Fetching rails-dom-testing 2.0.3
262Fetching loofah 2.21.3
263Fetching xpath 3.2.0
264Installing rails-dom-testing 2.0.3
265Installing loofah 2.21.3
266Fetching fog-xml 0.1.4
267Installing xpath 3.2.0
268Fetching amatch 0.4.1
269Fetching google-apis-core 0.9.0
270Fetching rspec-parameterized-core 1.0.0
271Installing fog-xml 0.1.4
272Fetching rails-html-sanitizer 1.5.0
273Installing amatch 0.4.1 with native extensions
274Installing rspec-parameterized-core 1.0.0
275Installing google-apis-core 0.9.0
276Fetching capybara 3.40.0
277Installing rails-html-sanitizer 1.5.0
278Fetching rspec-parameterized-table_syntax 1.0.0
279Fetching google-apis-compute_v1 0.51.0
280Installing rspec-parameterized-table_syntax 1.0.0
281Fetching google-apis-dns_v1 0.27.0
282Installing google-apis-dns_v1 0.27.0
283Fetching google-apis-iamcredentials_v1 0.14.0
284Installing capybara 3.40.0
285Installing google-apis-compute_v1 0.51.0
286Installing google-apis-iamcredentials_v1 0.14.0
287Fetching google-apis-monitoring_v3 0.33.0
288Fetching google-apis-pubsub_v1 0.28.0
289Fetching google-apis-sqladmin_v1beta4 0.36.0
290Installing google-apis-pubsub_v1 0.28.0
291Installing google-apis-monitoring_v3 0.33.0
292Fetching google-apis-storage_v1 0.19.0
293Fetching actionview 7.0.8.1
294Installing google-apis-sqladmin_v1beta4 0.36.0
295Fetching rspec-parameterized 1.0.0
296Installing google-apis-storage_v1 0.19.0
297Installing rspec-parameterized 1.0.0
298Fetching fog-google 1.19.0
299Installing actionview 7.0.8.1
300Fetching capybara-screenshot 1.0.26
301Installing fog-google 1.19.0
302Installing capybara-screenshot 1.0.26
303Fetching watir 7.1.0
304Installing watir 7.1.0
305Fetching chemlab 0.11.1
306Installing chemlab 0.11.1
307Fetching chemlab-library-www-gitlab-com 0.1.1
308Installing chemlab-library-www-gitlab-com 0.1.1
309Fetching ffi-compiler 1.0.1
310Installing ffi-compiler 1.0.1
311Fetching llhttp-ffi 0.4.0
312Installing llhttp-ffi 0.4.0 with native extensions
313Fetching http 5.1.1
314Installing http 5.1.1
315Fetching gitlab-qa 14.5.0
316Fetching gitlab_quality-test_tooling 1.21.0
317Installing gitlab_quality-test_tooling 1.21.0
318Installing gitlab-qa 14.5.0
319Bundle complete! 37 Gemfile dependencies, 140 gems now installed.
320Use `bundle info [gemname]` to see where a bundled gem is installed.
321Post-install message from rubyzip:
322RubyZip 3.0 is coming!
323**********************
324The public API of some Rubyzip classes has been modernized to use named
325parameters for optional arguments. Please check your usage of the
326following classes:
327 * `Zip::File`
328 * `Zip::Entry`
329 * `Zip::InputStream`
330 * `Zip::OutputStream`
331Please ensure that your Gemfiles and .gemspecs are suitably restrictive
332to avoid an unexpected breakage when 3.0 is released (e.g. ~> 2.3.0).
333See https://github.com/rubyzip/rubyzip for details. The Changelog also
334lists other enhancements and bugfixes that have been implemented since
335version 2.3.0.
336Post-install message from httparty:
337When you HTTParty, you must party hard!
338$ export QA_COMMAND="$BUNDLE_PREFIX gitlab-qa ${QA_SCENARIO:=Test::Instance::Image} $RELEASE $GITLAB_QA_OPTS -- $QA_TESTS $QA_RSPEC_TAGS $RSPEC_REPORT_OPTS"
339$ echo "Running - '$QA_COMMAND'"
340Running - 'bundle exec gitlab-qa Test::Integration::AiGatewayNoAddOn registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0 -- --format QA::Support::JsonFormatter --out tmp/rspec-6531945262.json --format RspecJunitFormatter --out tmp/rspec-6531945262.xml --format html --out tmp/rspec-$(echo ai-gateway-no-add-on | sed 's/[ /]/_/g').htm --color --format documentation'
341$ eval "$QA_COMMAND"
342[Apr 02 2024 20:29:45 UTC (Gitlab QA)] INFO -- Shell command: `docker pull -q telegraf:1.21-alpine`
343[Apr 02 2024 20:29:47 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^telegraf$`
344[Apr 02 2024 20:29:47 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name telegraf --user root --entrypoint telegraf --volume /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/telegraf:/etc/telegraf/log:z --volume /var/run/docker.sock:/var/run/docker.sock:z --volume /builds/d20240402-408-n6jiti/telegraf.conf:/etc/telegraf/telegraf.conf:ro --env QA_INFLUXDB_TOKEN="$QA_INFLUXDB_TOKEN" --env QA_INFLUXDB_URL="$QA_INFLUXDB_URL" --env QA_RUN_TYPE="$QA_RUN_TYPE" --env CI_JOB_NAME="$CI_JOB_NAME" telegraf:1.21-alpine`
345[Apr 02 2024 20:29:50 UTC (Gitlab QA)] INFO -- Shell command: `docker pull -q registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:latest`
346[Apr 02 2024 20:30:01 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^ai-gateway$`
347[Apr 02 2024 20:30:01 UTC (Gitlab QA)] INFO -- Shell command: `docker network list --format '{{.Name}}' --filter name=^test$`
348[Apr 02 2024 20:30:01 UTC (Gitlab QA)] INFO -- Shell command: `docker network create test`
349[Apr 02 2024 20:30:01 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name ai-gateway --net test --hostname ai-gateway.test -p 5000 --volume /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/ai-gateway/logs:/var/log/gitlab:z --env AIGW_GITLAB_URL="http://gitlab.test" --env AIGW_GITLAB_API_URL="http://gitlab.test/api/v4" --env AIGW_CUSTOMER_PORTAL_URL="https://customers.staging.gitlab.com" --env AIGW_USE_FAKE_MODELS="true" registry.gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/model-gateway:latest`
350[Apr 02 2024 20:30:07 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^alpine-2aa9b211$`
351[Apr 02 2024 20:30:07 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name alpine-2aa9b211 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z alpine/curl:latest tail -f /dev/null`
352[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/authority/. alpine-2aa9b211:/etc/gitlab/trusted-certs`
353[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/gitlab/. alpine-2aa9b211:/etc/gitlab/ssl`
354[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=alpine-2aa9b211`
355[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f alpine-2aa9b211`
356[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker login --username "gitlab-ci-token" --password "*****" registry.gitlab.com`
357[Apr 02 2024 20:30:09 UTC (Gitlab QA)] INFO -- Shell command: `docker pull -q registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
358[Apr 02 2024 20:30:55 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^gitlab$`
359[Apr 02 2024 20:30:55 UTC (Gitlab QA)] INFO -- Shell command: `docker network list --format '{{.Name}}' --filter name=^test$`
360[Apr 02 2024 20:30:55 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name gitlab --net test --hostname gitlab.test -p 80 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z --volume /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab/logs:/var/log/gitlab:Z registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
361[Apr 02 2024 20:31:12 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "echo \"# Generated by GitLab QA Omnibus Configurator at 2024-04-02 20:29:50
362gitlab_rails['gitlab_default_theme'] = 10 # Light Red Theme
363gitlab_rails['gitlab_disable_animations'] = true # Disable animations
364gitlab_rails['application_settings_cache_seconds'] = 0 # Settings cache expiry
365gitlab_rails['initial_root_password'] = '5iveL!fe' # Initial root password
366gitlab_rails['env'] = {'AI_GATEWAY_URL'=>'http://ai-gateway.test:5000', 'QA_EE_ACTIVATION_CODE'=>'*****', 'GITLAB_LICENSE_MODE'=>'test', 'CUSTOMER_PORTAL_URL'=>'https://customers.staging.gitlab.com', 'GITLAB_QA_USER_AGENT'=>'*****', 'GITLAB_ALLOW_SEPARATE_CI_DATABASE'=>'true'}\" > /etc/gitlab/gitlab.rb;"`
367[Apr 02 2024 20:31:12 UTC (Gitlab QA)] INFO -- Shell command: `docker attach --sig-proxy=false gitlab`
368[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Follow the document https://gitlab.com/gitlab-org/quality/runbooks/-/blob/main/debug_orchestrated_test_locally/ for debugging the test failure locally.
369[Apr 02 2024 20:31:17 UTC (Gitlab QA)] ERROR -- Tailing the reconfigure log file: /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-reconfigure.log. Please check /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-reconfigure.log file in the artifacts for more details.
370[Apr 02 2024 20:31:17 UTC (Gitlab QA)] WARN -- Retry instance_no_teardown due to Support::ShellCommand::StatusError -- attempt 1
371[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_all_tables order by n_live_tup DESC, n_dead_tup DESC;'"`
372[Apr 02 2024 20:31:17 UTC (Gitlab QA)] ERROR -- Shell command output:
373Error response from daemon: Container e9b3f8bfca8ae6b75a0d17ae0983226bd2c74a00d8ab53d178bf8998daba13af is not running
374[Apr 02 2024 20:31:17 UTC (Gitlab QA)] ERROR -- Error getting pg statistics: Command `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_a...` failed! ✘
375[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=gitlab`
376[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^alpine-cbbcb460$`
377[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name alpine-cbbcb460 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z alpine/curl:latest tail -f /dev/null`
378[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/authority/. alpine-cbbcb460:/etc/gitlab/trusted-certs`
379[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/gitlab/. alpine-cbbcb460:/etc/gitlab/ssl`
380[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=alpine-cbbcb460`
381[Apr 02 2024 20:31:17 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f alpine-cbbcb460`
382[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker login --username "gitlab-ci-token" --password "*****" registry.gitlab.com`
383[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker pull -q registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
384[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^gitlab$`
385[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f gitlab`
386[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker network list --format '{{.Name}}' --filter name=^test$`
387[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name gitlab --net test --hostname gitlab.test -p 80 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z --volume /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab/logs:/var/log/gitlab:Z registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
388[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "echo \"# Generated by GitLab QA Omnibus Configurator at 2024-04-02 20:29:50
389gitlab_rails['gitlab_default_theme'] = 10 # Light Red Theme
390gitlab_rails['gitlab_disable_animations'] = true # Disable animations
391gitlab_rails['application_settings_cache_seconds'] = 0 # Settings cache expiry
392gitlab_rails['initial_root_password'] = '5iveL!fe' # Initial root password
393gitlab_rails['env'] = {'AI_GATEWAY_URL'=>'http://ai-gateway.test:5000', 'QA_EE_ACTIVATION_CODE'=>'*****', 'GITLAB_LICENSE_MODE'=>'test', 'CUSTOMER_PORTAL_URL'=>'https://customers.staging.gitlab.com', 'GITLAB_QA_USER_AGENT'=>'*****', 'GITLAB_ALLOW_SEPARATE_CI_DATABASE'=>'true'}\" > /etc/gitlab/gitlab.rb;"`
394[Apr 02 2024 20:31:18 UTC (Gitlab QA)] INFO -- Shell command: `docker attach --sig-proxy=false gitlab`
395[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Follow the document https://gitlab.com/gitlab-org/quality/runbooks/-/blob/main/debug_orchestrated_test_locally/ for debugging the test failure locally.
396[Apr 02 2024 20:31:25 UTC (Gitlab QA)] ERROR -- Tailing the reconfigure log file: /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-retry-1-reconfigure.log. Please check /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-retry-1-reconfigure.log file in the artifacts for more details.
397[Apr 02 2024 20:31:25 UTC (Gitlab QA)] WARN -- Retry instance_no_teardown due to Support::ShellCommand::StatusError -- attempt 2
398[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_all_tables order by n_live_tup DESC, n_dead_tup DESC;'"`
399[Apr 02 2024 20:31:25 UTC (Gitlab QA)] ERROR -- Shell command output:
400Error response from daemon: Container 04e5d801d018d930b04787ff2a4d560dc30ede27fd40d2b8a0ae8cc59c71e285 is not running
401[Apr 02 2024 20:31:25 UTC (Gitlab QA)] ERROR -- Error getting pg statistics: Command `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_a...` failed! ✘
402[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=gitlab`
403[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^alpine-3a8741c7$`
404[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name alpine-3a8741c7 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z alpine/curl:latest tail -f /dev/null`
405[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/authority/. alpine-3a8741c7:/etc/gitlab/trusted-certs`
406[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker cp /builds/gitlab-org/gitlab/.gems/gems/gitlab-qa-14.5.0/tls_certificates/gitlab/. alpine-3a8741c7:/etc/gitlab/ssl`
407[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=alpine-3a8741c7`
408[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f alpine-3a8741c7`
409[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker login --username "gitlab-ci-token" --password "*****" registry.gitlab.com`
410[Apr 02 2024 20:31:25 UTC (Gitlab QA)] INFO -- Shell command: `docker pull -q registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
411[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker container list --all --format '{{.Names}}' --filter name=^gitlab$`
412[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f gitlab`
413[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker network list --format '{{.Name}}' --filter name=^test$`
414[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker run -d --name gitlab --net test --hostname gitlab.test -p 80 --volume authority:/etc/gitlab/trusted-certs:Z --volume gitlab-ssl:/etc/gitlab/ssl:Z --volume /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab/logs:/var/log/gitlab:Z registry.gitlab.com/gitlab-org/build/omnibus-gitlab-mirror/gitlab-ee:2abba690ffac683311a1724f1253c21a358acb6c-ruby3.0`
415[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "echo \"# Generated by GitLab QA Omnibus Configurator at 2024-04-02 20:29:50
416gitlab_rails['gitlab_default_theme'] = 10 # Light Red Theme
417gitlab_rails['gitlab_disable_animations'] = true # Disable animations
418gitlab_rails['application_settings_cache_seconds'] = 0 # Settings cache expiry
419gitlab_rails['initial_root_password'] = '5iveL!fe' # Initial root password
420gitlab_rails['env'] = {'AI_GATEWAY_URL'=>'http://ai-gateway.test:5000', 'QA_EE_ACTIVATION_CODE'=>'*****', 'GITLAB_LICENSE_MODE'=>'test', 'CUSTOMER_PORTAL_URL'=>'https://customers.staging.gitlab.com', 'GITLAB_QA_USER_AGENT'=>'*****', 'GITLAB_ALLOW_SEPARATE_CI_DATABASE'=>'true'}\" > /etc/gitlab/gitlab.rb;"`
421[Apr 02 2024 20:31:26 UTC (Gitlab QA)] INFO -- Shell command: `docker attach --sig-proxy=false gitlab`
422[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Tail of the reconfigure log file, see artifacts for full log: /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-retry-2-reconfigure.log
423[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `tail -n 100 /builds/gitlab-org/gitlab/gitlab-qa-run-2024-04-02-20-29-45-93a1d35b/gitlab-retry-2-reconfigure.log`
424[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_all_tables order by n_live_tup DESC, n_dead_tup DESC;'"`
425[Apr 02 2024 20:31:31 UTC (Gitlab QA)] ERROR -- Shell command output:
426Error response from daemon: Container cddc193208624bb8f2a65ed63d11fcffbb455be8a407b1288a993f8852c23c4a is not running
427[Apr 02 2024 20:31:31 UTC (Gitlab QA)] ERROR -- Error getting pg statistics: Command `docker exec gitlab bash -c "gitlab-psql -c 'select n_live_tup, n_dead_tup, relname from pg_stat_a...` failed! ✘
428[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=gitlab`
429[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=ai-gateway`
430[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f ai-gateway`
431[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker ps -f name=telegraf`
432[Apr 02 2024 20:31:31 UTC (Gitlab QA)] INFO -- Shell command: `docker rm -f telegraf`
433bundler: failed to load command: gitlab-qa (/builds/gitlab-org/gitlab/.gems/bin/gitlab-qa)
434/usr/local/bin/bundle: Command `docker attach --sig-proxy=false gitlab` failed! \e[31m✘\e[0m (Gitlab::QA::Support::ShellCommand::StatusError)
435 Running after_script 00:01
436Running after script...
437$ if [ "$CI_JOB_STATUS" == "failed" ]; then # collapsed multi-line command
438$ export BUNDLE_PREFIX=$([ "$RUN_WITH_BUNDLE" != "true" ] || echo "bundle exec")
439$ echo -e "\e[0Ksection_start:`date +%s`:report_results_section[collapsed=true]\r\e[0KReport results"
440 Report results 00:00
445 Uploading artifacts for failed job 00:02
446Uploading artifacts...
447gitlab-qa-run-*: found 18 matching artifact files and directories
448Uploading artifacts as "archive" to coordinator... 201 Created id=6531945262 responseStatus=201 Created token=glcbt-65
449Uploading artifacts...
450WARNING: gitlab-qa-run-*/**/rspec-*.xml: no matching files. Ensure that the artifact path is relative to the working directory (/builds/gitlab-org/gitlab)
451ERROR: No files to upload
452Uploading artifacts...
453/builds/gitlab-org/gitlab/suite_status.env: found 1 matching artifact files and directories
454Uploading artifacts as "dotenv" to coordinator... 201 Created id=6531945262 responseStatus=201 Created token=glcbt-65
455 Cleaning up project directory and file based variables 00:00
456ERROR: Job failed: exit code 1