GDK and Sidekiq crash at startup due missing merge_request_diff_commits
When I started up GDK, it crashed immediately:
20:29:16 redis.1 | started with pid 21250
20:29:16 postgresql.1 | started with pid 21251
20:29:16 gitlab-workhorse.1 | started with pid 21252
20:29:16 rails-web.1 | started with pid 21253
20:29:16 rails-background-jobs.1 | started with pid 21254
20:29:16 gitaly.1 | started with pid 21255
20:29:16 webpack.1 | started with pid 21256
20:29:16 redis.1 | 21250:M 06 Jul 20:29:16.850 * Increased maximum number of open files to 10032 (it was originally set to 256).
20:29:16 redis.1 | _._
20:29:16 redis.1 | _.-``__ ''-._
20:29:16 redis.1 | _.-`` `. `_. ''-._ Redis 3.2.1 (00000000/0) 64 bit
20:29:16 redis.1 | .-`` .-```. ```\/ _.,_ ''-._
20:29:16 redis.1 | ( ' , .-` | `, ) Running in standalone mode
20:29:16 redis.1 | |`-._`-...-` __...-.``-._|'` _.-'| Port: 0
20:29:16 redis.1 | | `-._ `._ / _.-' | PID: 21250
20:29:16 redis.1 | `-._ `-._ `-./ _.-' _.-'
20:29:16 redis.1 | |`-._`-._ `-.__.-' _.-'_.-'|
20:29:16 redis.1 | | `-._`-._ _.-'_.-' | http://redis.io
20:29:16 redis.1 | `-._ `-._`-.__.-'_.-' _.-'
20:29:16 redis.1 | |`-._`-._ `-.__.-' _.-'_.-'|
20:29:16 redis.1 | | `-._`-._ _.-'_.-' |
20:29:16 redis.1 | `-._ `-._`-.__.-'_.-' _.-'
20:29:16 redis.1 | `-._ `-.__.-' _.-'
20:29:16 redis.1 | `-._ _.-'
20:29:16 redis.1 | `-.__.-'
20:29:16 redis.1 |
20:29:16 redis.1 | 21250:M 06 Jul 20:29:16.851 # Server started, Redis version 3.2.1
20:29:16 redis.1 | 21250:M 06 Jul 20:29:16.851 * DB loaded from disk: 0.000 seconds
20:29:16 redis.1 | 21250:M 06 Jul 20:29:16.851 * The server is now ready to accept connections at /Users/stanhu/gitlab/gdk/redis/redis.socket
20:29:16 gitlab-workhorse.1 | 2017/07/06 20:29:16 Starting gitlab-workhorse (unknown version)
20:29:16 gitaly.1 | time="2017-07-06T20:29:16-07:00" level=info msg="Starting Gitaly" version=
20:29:16 gitaly.1 | time="2017-07-06T20:29:16-07:00" level=info msg="listening on unix socket" address="/Users/stanhu/gitlab/gdk/gitaly.socket"
20:29:16 gitlab-workhorse.1 | 2017/07/06 20:29:16 keywatcher: starting process loop
20:29:16 gitlab-workhorse.1 | 2017/07/06 20:29:16 redis: dialing "unix", "/Users/stanhu/gitlab/gdk/redis/redis.socket"
20:29:16 gitaly.1 | time="2017-07-06T20:29:16-07:00" level=info msg="Starting prometheus listener" address="localhost:9236"
20:29:16 postgresql.1 | LOG: database system was shut down at 2017-07-06 20:28:31 PDT
20:29:16 postgresql.1 | LOG: MultiXact member wraparound protections are now enabled
20:29:16 postgresql.1 | LOG: autovacuum launcher started
20:29:16 postgresql.1 | LOG: database system is ready to accept connections
20:29:17 webpack.1 | yarn dev-server v0.24.6
20:29:17 webpack.1 | $ nodemon --watch config/webpack.config.js -- ./node_modules/.bin/webpack-dev-server --config config/webpack.config.js
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.750097 #21253] INFO -- : unlinking existing socket=/Users/stanhu/gitlab/gdk/gitlab.socket
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.750381 #21253] INFO -- : listening on addr=/Users/stanhu/gitlab/gdk/gitlab.socket fd=11
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.750465 #21253] INFO -- : worker=0 spawning...
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.751974 #21253] INFO -- : worker=1 spawning...
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.752453 #21253] INFO -- : master process ready
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.753363 #21273] INFO -- : worker=0 spawned pid=21273
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.753524 #21274] INFO -- : worker=1 spawned pid=21274
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.753804 #21273] INFO -- : Refreshing Gem list
20:29:17 rails-web.1 | I, [2017-07-06T20:29:17.753841 #21274] INFO -- : Refreshing Gem list
20:29:17 webpack.1 | [nodemon] 1.11.0
20:29:17 webpack.1 | [nodemon] to restart at any time, enter `rs`
20:29:17 webpack.1 | [nodemon] watching: config/webpack.config.js
20:29:17 webpack.1 | [nodemon] starting `node ./node_modules/.bin/webpack-dev-server --config config/webpack.config.js`
20:29:18 webpack.1 | Project is running at http://localhost:3808/
20:29:18 webpack.1 | webpack output is served from /assets/webpack/
20:29:22 rails-web.1 | WARNING: This version of GitLab depends on gitlab-shell 5.1.1, but you're running 5.1.0. Please update gitlab-shell.
20:29:22 rails-web.1 | WARNING: This version of GitLab depends on gitlab-shell 5.1.1, but you're running 5.1.0. Please update gitlab-shell.
20:29:22 rails-background-jobs.1 | WARNING: This version of GitLab depends on gitlab-shell 5.1.1, but you're running 5.1.0. Please update gitlab-shell.
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.088Z 21254 TID-ox9engh54 INFO: Booting Sidekiq 5.0.0 with redis options {:path=>"/Users/stanhu/gitlab/gdk/redis/redis.socket", :namespace=>"resque:gitlab", :url=>nil}
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.109Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: stuck_ci_jobs_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.116Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: pipeline_schedule_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.130Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: expire_build_artifacts_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.141Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: repository_check_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.149Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: admin_email_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.156Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: repository_archive_cache_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.164Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: import_export_project_cleanup_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.172Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: requests_profiles_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.179Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: remove_expired_members_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.186Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: remove_expired_group_links_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.193Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: prune_old_events_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.201Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: trending_projects_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.209Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: remove_unreferenced_lfs_objects_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.219Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: stuck_import_jobs_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.228Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: gitlab_usage_ping_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.237Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: schedule_update_user_activity_worker
20:29:23 rails-background-jobs.1 | 2017-07-07T03:29:23.244Z 21254 TID-ox9engh54 INFO: Cron Jobs - add job with name: remove_old_web_hook_logs_worker
20:29:25 rails-web.1 | I, [2017-07-06T20:29:25.737995 #21274] INFO -- : worker=1 ready
20:29:25 rails-web.1 | I, [2017-07-06T20:29:25.762062 #21273] INFO -- : worker=0 ready
20:29:28 postgresql.1 | ERROR: relation "merge_request_diff_commits" does not exist at character 323
20:29:28 postgresql.1 | STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),
20:29:28 postgresql.1 | pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod
20:29:28 postgresql.1 | FROM pg_attribute a LEFT JOIN pg_attrdef d
20:29:28 postgresql.1 | ON a.attrelid = d.adrelid AND a.attnum = d.adnum
20:29:28 postgresql.1 | WHERE a.attrelid = '"merge_request_diff_commits"'::regclass
20:29:28 postgresql.1 | AND a.attnum > 0 AND NOT a.attisdropped
20:29:28 postgresql.1 | ORDER BY a.attnum
20:29:28 postgresql.1 |
20:29:28 rails-background-jobs.1 | PG::UndefinedTable: ERROR: relation "merge_request_diff_commits" does not exist
20:29:28 rails-background-jobs.1 | LINE 5: WHERE a.attrelid = '"merge_request_diff_commi...
20:29:28 rails-background-jobs.1 | ^
20:29:28 rails-background-jobs.1 | : SELECT a.attname, format_type(a.atttypid, a.atttypmod),
20:29:28 rails-background-jobs.1 | pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod
20:29:28 rails-background-jobs.1 | FROM pg_attribute a LEFT JOIN pg_attrdef d
20:29:28 rails-background-jobs.1 | ON a.attrelid = d.adrelid AND a.attnum = d.adnum
20:29:28 rails-background-jobs.1 | WHERE a.attrelid = '"merge_request_diff_commits"'::regclass
20:29:28 rails-background-jobs.1 | AND a.attnum > 0 AND NOT a.attisdropped
20:29:28 rails-background-jobs.1 | ORDER BY a.attnum
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/peek-pg-1.3.0/lib/peek/views/pg.rb:17:in `async_exec'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/peek-pg-1.3.0/lib/peek/views/pg.rb:17:in `async_exec'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:592:in `block in exec_no_cache'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/abstract_adapter.rb:484:in `block in log'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/notifications/instrumenter.rb:20:in `instrument'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/abstract_adapter.rb:478:in `log'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:592:in `exec_no_cache'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:584:in `execute_and_clear'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql/database_statements.rb:160:in `exec_query'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql_adapter.rb:733:in `column_definitions'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/postgresql/schema_statements.rb:197:in `columns'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/connection_adapters/schema_cache.rb:43:in `columns'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activerecord-4.2.8/lib/active_record/attributes.rb:93:in `columns'
20:29:28 rails-background-jobs.1 | /Users/stanhu/gitlab/gdk/gitlab/app/models/concerns/sha_attribute.rb:6:in `sha_attribute'
20:29:28 rails-background-jobs.1 | /Users/stanhu/gitlab/gdk/gitlab/app/models/merge_request_diff_commit.rb:6:in `<class:MergeRequestDiffCommit>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/gitlab/gdk/gitlab/app/models/merge_request_diff_commit.rb:1:in `<main>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:63:in `load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:63:in `load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:457:in `block in load_file'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:647:in `new_constants_in'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:456:in `load_file'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:354:in `require_or_load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:317:in `depend_on'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/active_support.rb:59:in `block in depend_on'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/active_support.rb:6:in `with_bootsnap_fallback'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/active_support.rb:59:in `depend_on'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:233:in `require_dependency'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:472:in `block (2 levels) in eager_load!'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:471:in `each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:471:in `block in eager_load!'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:469:in `each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:469:in `eager_load!'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/engine.rb:346:in `eager_load!'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/application/finisher.rb:56:in `each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/application/finisher.rb:56:in `block in <module:Finisher>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/initializable.rb:30:in `instance_exec'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/initializable.rb:30:in `run'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/initializable.rb:55:in `block in run_initializers'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:228:in `block in tsort_each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:431:in `each_strongly_connected_component_from'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:349:in `block in each_strongly_connected_component'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:347:in `each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:347:in `call'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:347:in `each_strongly_connected_component'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:226:in `tsort_each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/2.3.0/tsort.rb:205:in `tsort_each'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/initializable.rb:54:in `run_initializers'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/railties-4.2.8/lib/rails/application.rb:352:in `initialize!'
20:29:28 rails-background-jobs.1 | /Users/stanhu/gitlab/gdk/gitlab/config/environment.rb:5:in `<main>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:17:in `require'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bootsnap-1.1.1/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:17:in `require'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:274:in `block in require'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:240:in `load_dependency'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/activesupport-4.2.8/lib/active_support/dependencies.rb:274:in `require'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/sidekiq-5.0.0/lib/sidekiq/cli.rb:252:in `boot_system'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/sidekiq-5.0.0/lib/sidekiq/cli.rb:54:in `run'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/sidekiq-5.0.0/bin/sidekiq:12:in `<top (required)>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/bin/sidekiq:22:in `load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/bin/sidekiq:22:in `<top (required)>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli/exec.rb:74:in `load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli/exec.rb:74:in `kernel_load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli/exec.rb:27:in `run'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli.rb:332:in `exec'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/vendor/thor/lib/thor.rb:359:in `dispatch'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli.rb:20:in `dispatch'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/vendor/thor/lib/thor/base.rb:440:in `start'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/cli.rb:11:in `start'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/exe/bundle:34:in `block in <top (required)>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/lib/bundler/friendly_errors.rb:100:in `with_friendly_errors'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/lib/ruby/gems/2.3.0/gems/bundler-1.13.6/exe/bundle:26:in `<top (required)>'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/bin/bundle:22:in `load'
20:29:28 rails-background-jobs.1 | /Users/stanhu/.rbenv/versions/2.3.3/bin/bundle:22:in `<main>'
20:29:28 rails-background-jobs.1 | exited with code 1
20:29:28 system | sending SIGTERM to all processes
20:29:28 redis.1 | 21250:signal-handler (1499398168) Received SIGTERM scheduling shutdown...
20:29:28 postgresql.1 | LOG: received fast shutdown request
20:29:28 postgresql.1 | LOG: aborting any active transactions
20:29:28 postgresql.1 | FATAL: terminating connection due to administrator command
20:29:28 postgresql.1 | FATAL: terminating connection due to administrator command
20:29:28 postgresql.1 | LOG: autovacuum launcher shutting down
20:29:28 gitaly.1 | terminated by SIGTERM
20:29:28 gitlab-workhorse.1 | terminated by SIGTERM
20:29:28 postgresql.1 | LOG: shutting down
20:29:28 postgresql.1 | LOG: database system is shut down
20:29:28 webpack.1 | terminated by SIGTERM
20:29:28 postgresql.1 | Sending INT to 21257
20:29:28 postgresql.1 | exited with code 0
20:29:29 redis.1 | 21250:M 06 Jul 20:29:29.022 # User requested shutdown...
20:29:29 redis.1 | 21250:M 06 Jul 20:29:29.022 * Removing the unix socket file.
20:29:29 redis.1 | 21250:M 06 Jul 20:29:29.022 # Redis is now ready to exit, bye bye...
20:29:29 redis.1 | exited with code 0
20:29:29 rails-web.1 | I, [2017-07-06T20:29:29.032657 #21253] INFO -- : reaped #<Process::Status: pid 21274 exit 0> worker=1
20:29:29 rails-web.1 | I, [2017-07-06T20:29:29.032920 #21253] INFO -- : reaped #<Process::Status: pid 21273 exit 0> worker=0
20:29:29 rails-web.1 | I, [2017-07-06T20:29:29.033322 #21253] INFO -- : master complete
20:29:29 rails-web.1 | exited with code 0
Can probably workaround this by just running the DB, but we shouldn't have to do this.
/cc: @smcgivern
Edited by Stan Hu