Failure on upgrade from gitlab-ce_11.8.3 to gitlab-ce_11.9.0
I'm having a similar, if not the same, issue upgrading from gitlab-ce_11.8.3-ce.0 to gitlab-ce_11.9.0 using the Debian omnibus package. I do not have any gitlab broadcast messages running at the moment, and none in the expired state.
After upgrade, the instance starts generating gitlab branded error 502 pages.
After a gitlab-ctl restart
it ceases to generate pages at all, resulting in my front end load balancer timing out after 15 seconds.
I'm seeing messages like this:
==> unicorn/unicorn_stderr.log <==
E, [2019-03-25T19:36:27.232694 #35983] ERROR -- : listen loop error: Protocol not available - getsockopt(TCP_CORK/TCP_NOPUSH) (Errno::ENOPROTOOPT)
E, [2019-03-25T19:36:27.233310 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:700:in `kgio_tryaccept'
E, [2019-03-25T19:36:27.234560 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:700:in `worker_loop'
E, [2019-03-25T19:36:27.234654 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:549:in `spawn_missing_workers'
E, [2019-03-25T19:36:27.234760 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/unicorn-5.4.1/lib/unicorn/http_server.rb:142:in `start'
E, [2019-03-25T19:36:27.234824 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/unicorn-5.4.1/bin/unicorn:126:in `<top (required)>'
E, [2019-03-25T19:36:27.234909 #35983] ERROR -- : /opt/gitlab/embedded/bin/unicorn:23:in `load'
E, [2019-03-25T19:36:27.234970 #35983] ERROR -- : /opt/gitlab/embedded/bin/unicorn:23:in `<top (required)>'
E, [2019-03-25T19:36:27.235053 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli/exec.rb:74:in `load'
E, [2019-03-25T19:36:27.235406 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli/exec.rb:74:in `kernel_load'
E, [2019-03-25T19:36:27.235498 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli/exec.rb:28:in `run'
E, [2019-03-25T19:36:27.235561 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli.rb:424:in `exec'
E, [2019-03-25T19:36:27.235646 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
E, [2019-03-25T19:36:27.235733 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
E, [2019-03-25T19:36:27.235795 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/vendor/thor/lib/thor.rb:387:in `dispatch'
E, [2019-03-25T19:36:27.235856 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli.rb:27:in `dispatch'
E, [2019-03-25T19:36:27.235939 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/vendor/thor/lib/thor/base.rb:466:in `start'
E, [2019-03-25T19:36:27.236002 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/cli.rb:18:in `start'
E, [2019-03-25T19:36:27.236086 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/exe/bundle:30:in `block in <top (required)>'
E, [2019-03-25T19:36:27.236185 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/lib/bundler/friendly_errors.rb:124:in `with_friendly_errors'
E, [2019-03-25T19:36:27.236276 #35983] ERROR -- : /opt/gitlab/embedded/lib/ruby/gems/2.5.0/gems/bundler-1.16.6/exe/bundle:22:in `<top (required)>'
E, [2019-03-25T19:36:27.236395 #35983] ERROR -- : /opt/gitlab/embedded/bin/bundle:23:in `load'
E, [2019-03-25T19:36:27.236477 #35983] ERROR -- : /opt/gitlab/embedded/bin/bundle:23:in `<main>'
These messages correspond to when I attempt to load the root of my gitlab deployment.
apt-get install gitlab-ce=11.8.3-ce.0
restores the system to operation.
How can I be of service providing more diagnostics?
New ticket created as requested.