Gitaly image failing to start up
Summary
Per https://gitlab.com/nick.thomas/gitlab-workhorse/-/jobs/122923642 - the Gitaly process inside the Gitaly docker image is failing to start, complaining of missing gems. We use this image as a service container in Workhorse tests.
@balasankarc suggested this could be a result of gitlab-org/build/CNG!177 (merged)
Steps to reproduce
Try to run the CNG gitaly image
Configuration used
(Please provide a sanitized version of the configuration used wrapped in a code block (```yaml))
.gitlab-ci.yml
.test_template: &test_definition
services:
- name: registry.gitlab.com/gitlab-org/build/cng/gitaly:latest
# Disable the hooks so we don't have to stub the GitLab API
command: ["bash", "-c", "mkdir -p /home/git/repositories && rm -rf /srv/gitlab-shell/hooks/* && exec /scripts/process-wrapper"]
alias: gitaly
variables:
GITALY_ADDRESS: "tcp://gitaly:8075"
Current behavior
*** WARNING: Service runner-0277ea0f-project-1694076-concurrent-0-registry.gitlab.com__gitlab-org__build__cng__gitaly-0 probably didn't start properly.
Health check error:
exit code 1
Health check container logs:
2018-11-20T12:37:49.128592533Z No HOST or PORT
Service container logs:
2018-11-20T12:37:47.990173468Z + /scripts/set-config /etc/gitaly /etc/gitaly
2018-11-20T12:37:48.096436225Z Begin parsing .erb files from /etc/gitaly
2018-11-20T12:37:48.097370898Z + exec bash -c 'mkdir -p /home/git/repositories && rm -rf /srv/gitlab-shell/hooks/* && exec /scripts/process-wrapper'
2018-11-20T12:37:48.103284593Z Starting Gitaly
2018-11-20T12:37:48.104503950Z ==> /var/log/gitaly/gitaly.log <==
2018-11-20T12:37:48.104514675Z
2018-11-20T12:37:48.104517713Z ==> /var/log/gitaly/gitlab-shell.log <==
2018-11-20T12:37:48.119974479Z
2018-11-20T12:37:48.119987531Z ==> /var/log/gitaly/gitaly.log <==
2018-11-20T12:37:48.119991809Z time="2018-11-20T12:37:48Z" level=info msg="Starting Gitaly" version="Gitaly, version unknown, built 20181120.043013"
2018-11-20T12:37:48.120145322Z time="2018-11-20T12:37:48Z" level=warning msg="git path not configured. Using default path resolution" resolvedPath=/usr/local/bin/git
2018-11-20T12:37:48.122149214Z time="2018-11-20T12:37:48Z" level=warning msg="git path not configured. Using default path resolution" resolvedPath=/usr/local/bin/git
2018-11-20T12:37:48.522221121Z /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/spec_set.rb:91:in `block in materialize': Could not find abstract_type-0.0.7 in any of the sources (Bundler::GemNotFound)
2018-11-20T12:37:48.522273191Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/spec_set.rb:85:in `map!'
2018-11-20T12:37:48.522333244Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/spec_set.rb:85:in `materialize'
2018-11-20T12:37:48.522373183Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/definition.rb:171:in `specs'
2018-11-20T12:37:48.522441583Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/definition.rb:238:in `specs_for'
2018-11-20T12:37:48.522479655Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/definition.rb:227:in `requested_specs'
2018-11-20T12:37:48.522530506Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/runtime.rb:108:in `block in definition_method'
2018-11-20T12:37:48.522571131Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/runtime.rb:20:in `setup'
2018-11-20T12:37:48.522622898Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler.rb:107:in `setup'
2018-11-20T12:37:48.522683549Z from /usr/lib/ruby/gems/2.4.0/gems/bundler-1.16.2/lib/bundler/setup.rb:20:in `<top (required)>'
2018-11-20T12:37:48.522744695Z from /usr/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:59:in `require'
2018-11-20T12:37:48.522781989Z from /usr/lib/ruby/site_ruby/2.4.0/rubygems/core_ext/kernel_require.rb:59:in `require'
2018-11-20T12:37:48.524754612Z time="2018-11-20T12:37:48Z" level=fatal msg="load config" config_path=/etc/gitaly/config.toml error="load linguist colors: exit status 1; stderr: \"\""
Expected behavior
The process should find all its gems and run as normal
Versions
- Chart: none
- Platform:
- Cloud: GKE?
- Kubernetes: none
- Helm: none