redis not working on GitLab11.2.3-ee install
Installed Gitlab on CentOS 6.5. It worked for a day, but now redis is misbehaving and I'm getting 502/500 errors when trying to view Gitlab.
run: alertmanager: (pid 12886) 0s; run: log: (pid 9159) 300392s
run: gitaly: (pid 6621) 478s; run: log: (pid 9050) 300395s
run: gitlab-monitor: (pid 6636) 478s; run: log: (pid 9106) 300393s
run: gitlab-workhorse: (pid 6640) 477s; run: log: (pid 9020) 300395s
run: logrotate: (pid 6667) 477s; run: log: (pid 9022) 300395s
run: nginx: (pid 12854) 2s; run: log: (pid 9021) 300395s
run: node-exporter: (pid 6682) 476s; run: log: (pid 9051) 300395s
run: postgres-exporter: (pid 6687) 476s; run: log: (pid 9128) 300392s
run: postgresql: (pid 6704) 476s; run: log: (pid 8998) 300396s
run: prometheus: (pid 6719) 475s; run: log: (pid 9139) 300392s
run: redis: (pid 5801) 583s, got TERM; down: log: 1s, normally up, want up
run: redis-exporter: (pid 6740) 475s; run: log: (pid 9061) 300394s
run: sidekiq: (pid 12609) 20s; run: log: (pid 9000) 300396s
run: unicorn: (pid 6748) 475s; run: log: (pid 8999) 300396s
I've tried killing that process and restarting it with gitlab-ctl, but it just gets back into this "got TERM" state.
Some random other info: var/log/gitlab/redis/current remains empty through all of this.
Redis-related permissions
# ls -ld /var/opt/gitlab/redis
drwxr-x--- 2 gitlab-redis git 4096 Sep 20 01:56 /var/opt/gitlab/redis
This just kinda stays like this:
gitlab-ctl tail redis
==> /var/log/gitlab/redis/state <==
==> /var/log/gitlab/redis/current <==
Version info:
System information
System:
Proxy: no
Current User: git
Using RVM: no
Ruby Version: 2.4.4p296
Gem Version: 2.7.6
Bundler Version:1.16.2
Rake Version: 12.3.1
Redis Version: 3.2.11
Git Version: 2.18.0
Sidekiq Version:5.1.3
Go Version: unknown
GitLab information
Version: 11.2.3-ee
Revision: aadca99
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: postgresql
DB Version: 9.6.8
<snip>
Elasticsearch: no
Geo: no
Using LDAP: no
Using Omniauth: no
GitLab Shell
Version: 8.1.1
Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories
Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks
Git: /opt/gitlab/embedded/bin/git
Edited by Reil