Error 500, log says MISCONF Redis, cannot persist on disk, requires restart
Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.
Summary
I installed CE about a week ago (on a fresh, clean Ubuntu 16.x VPS with 4GB RAM) and then updated to EE a few days later. After setting up several users and importing most of our repos from GitHub I now have to restart the server regularly due to 500 errors. I've been running in the foreground with sudo gitlab-ctl tail which shows this:
Redis::CommandError (MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error.)Steps to reproduce
No idea.
Expected behavior
Server should run smoothly and all services should remain active. At the very least, visiting a repo's README should not fail due to a database write error.
Actual behavior
Redis fails snapshot writes and then the server only responds with 500
Relevant logs and/or screenshots
==> /var/log/gitlab/gitlab-workhorse/current <==
2017-01-14_15:48:49.23119 2017/01/14 15:48:49 ErrorPage: serving predefined error page: 500
2017-01-14_15:48:49.23131 git.daplie.com 127.0.0.1:35318 - - [2017-01-14 15:48:48.814992512 +0000 UTC] "GET /import/github/jobs HTTP/1.1" 500 2648 "https://git.daplie.com/import/github/status" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36" 0.415621
==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/coolaj86/waste-angular/commit/03ca5a7318fa639bb46d75f68e54189f911eba5f" for 66.249.69.199 at 2017-01-14 15:48:50 +0000
Processing by Projects::CommitController#show as HTML
Parameters: {"namespace_id"=>"coolaj86", "project_id"=>"waste-angular", "id"=>"03ca5a7318fa639bb46d75f68e54189f911eba5f"}
Completed 500 Internal Server Error in 86ms (ActiveRecord: 4.9ms)
ActionView::Template::Error (MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error.):
30: %li.visible-xs-block.visible-sm-block
31: = link_to namespace_project_tree_path(@project.namespace, @project, @commit) do
32: Browse Files
33: - unless @commit.has_been_reverted?(current_user)
34: %li.clearfix
35: = revert_commit_link(@commit, namespace_project_commit_path(@project.namespace, @project, @commit.id), has_tooltip: false)
36: %li.clearfix
lib/banzai/renderer.rb:108:in `block in cache_collection_render'
lib/banzai/renderer.rb:106:in `each'
lib/banzai/renderer.rb:106:in `cache_collection_render'
lib/banzai/reference_extractor.rb:26:in `html_documents'
lib/banzai/reference_extractor.rb:16:in `references'
lib/gitlab/reference_extractor.rb:21:in `references'
lib/gitlab/reference_extractor.rb:26:in `block (2 levels) in <class:ReferenceExtractor>'
app/models/commit.rb:280:in `has_been_reverted?'
app/views/projects/commit/_commit_box.html.haml:33:in `_app_views_projects_commit__commit_box_html_haml__2689378452650222546_70203651458740'
app/views/projects/commit/show.html.haml:7:in `_app_views_projects_commit_show_html_haml___1811145696500553444_70203650315040'
app/controllers/projects/commit_controller.rb:24:in `show'
lib/gitlab/middleware/multipart.rb:93:in `call'
lib/gitlab/request_profiler/middleware.rb:15:in `call'
lib/gitlab/middleware/go.rb:16:in `call'
lib/gitlab/middleware/readonly_geo.rb:29:in `call'
==> /var/log/gitlab/gitlab-workhorse/current <==
2017-01-14_15:48:50.20305 2017/01/14 15:48:50 ErrorPage: serving predefined error page: 500
2017-01-14_15:48:50.20349 git.daplie.com 127.0.0.1:35318 - - [2017-01-14 15:48:50.094135473 +0000 UTC] "GET /coolaj86/waste-angular/commit/03ca5a7318fa639bb46d75f68e54189f911eba5f HTTP/1.1" 500 2648 "" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 0.109176
==> /var/log/gitlab/sidekiq/current <==
2017-01-14_15:48:51.27661 2017-01-14T15:48:51.276Z 23874 TID-oxp6d9pw8 ERROR: heartbeat: EXECABORT Transaction discarded because of previous errors.
==> /var/log/gitlab/gitlab-rails/production.log <==
Started GET "/import/github/jobs" for 98.202.114.42 at 2017-01-14 15:48:52 +0000
Processing by Import::GithubController#jobs as */*
Completed 200 OK in 325ms (Views: 0.2ms | ActiveRecord: 7.2ms)
Redis::CommandError (MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error.):
redis (3.2.2) lib/redis/client.rb:114:in `call'
redis (3.2.2) lib/redis.rb:729:in `block in setex'
redis (3.2.2) lib/redis.rb:57:in `block in synchronize'
/opt/gitlab/embedded/lib/ruby/2.3.0/monitor.rb:214:in `mon_synchronize'
redis (3.2.2) lib/redis.rb:57:in `synchronize'
redis (3.2.2) lib/redis.rb:728:in `setex'
redis-store (1.2.0) lib/redis/store/interface.rb:17:in `setex'
redis-store (1.2.0) lib/redis/store/marshalling.rb:13:in `block in setex'
redis-store (1.2.0) lib/redis/store/marshalling.rb:29:in `_marshal'
redis-store (1.2.0) lib/redis/store/marshalling.rb:13:in `setex'
redis-store (1.2.0) lib/redis/store/namespace.rb:11:in `block in setex'
redis-store (1.2.0) lib/redis/store/namespace.rb:84:in `namespace'
redis-store (1.2.0) lib/redis/store/namespace.rb:11:in `setex'
redis-store (1.2.0) lib/redis/store/ttl.rb:6:in `set'
redis-store (1.2.0) lib/redis/store/marshalling.rb:5:in `block in set'
redis-store (1.2.0) lib/redis/store/marshalling.rb:29:in `_marshal'
redis-store (1.2.0) lib/redis/store/marshalling.rb:5:in `set'
redis-store (1.2.0) lib/redis/store/namespace.rb:7:in `block in set'
redis-store (1.2.0) lib/redis/store/namespace.rb:84:in `namespace'
redis-store (1.2.0) lib/redis/store/namespace.rb:7:in `set'
redis-rack (1.6.0) lib/rack/session/redis.rb:41:in `block in set_session'
redis-rack (1.6.0) lib/rack/session/redis.rb:55:in `with_lock'
redis-rack (1.6.0) lib/rack/session/redis.rb:40:in `set_session'
rack (1.6.5) lib/rack/session/abstract/id.rb:342:in `commit_session'
rack (1.6.5) lib/rack/session/abstract/id.rb:226:in `context'
rack (1.6.5) lib/rack/session/abstract/id.rb:220:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/cookies.rb:560:in `call'
activerecord (4.2.7.1) lib/active_record/query_cache.rb:36:in `call'
activerecord (4.2.7.1) lib/active_record/connection_adapters/abstract/connection_pool.rb:653:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/callbacks.rb:29:in `block in call'
activesupport (4.2.7.1) lib/active_support/callbacks.rb:88:in `__run_callbacks__'
activesupport (4.2.7.1) lib/active_support/callbacks.rb:778:in `_run_call_callbacks'
activesupport (4.2.7.1) lib/active_support/callbacks.rb:81:in `run_callbacks'
actionpack (4.2.7.1) lib/action_dispatch/middleware/callbacks.rb:27:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/remote_ip.rb:78:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/debug_exceptions.rb:17:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/show_exceptions.rb:30:in `call'
railties (4.2.7.1) lib/rails/rack/logger.rb:38:in `call_app'
railties (4.2.7.1) lib/rails/rack/logger.rb:20:in `block in call'
activesupport (4.2.7.1) lib/active_support/tagged_logging.rb:68:in `block in tagged'
activesupport (4.2.7.1) lib/active_support/tagged_logging.rb:26:in `tagged'
activesupport (4.2.7.1) lib/active_support/tagged_logging.rb:68:in `tagged'
railties (4.2.7.1) lib/rails/rack/logger.rb:20:in `call'
request_store (1.3.1) lib/request_store/middleware.rb:9:in `call'
actionpack (4.2.7.1) lib/action_dispatch/middleware/request_id.rb:21:in `call'
rack (1.6.5) lib/rack/methodoverride.rb:22:in `call'
rack (1.6.5) lib/rack/runtime.rb:18:in `call'
rack (1.6.5) lib/rack/lock.rb:17:in `call'
rack (1.6.5) lib/rack/sendfile.rb:113:in `call'
sentry-raven (2.0.2) lib/raven/integrations/rack.rb:50:in `call'
railties (4.2.7.1) lib/rails/engine.rb:518:in `call'
railties (4.2.7.1) lib/rails/application.rb:165:in `call'
railties (4.2.7.1) lib/rails/railtie.rb:194:in `public_send'
railties (4.2.7.1) lib/rails/railtie.rb:194:in `method_missing'
rack (1.6.5) lib/rack/urlmap.rb:66:in `block in call'
rack (1.6.5) lib/rack/urlmap.rb:50:in `each'
rack (1.6.5) lib/rack/urlmap.rb:50:in `call'
unicorn (5.1.0) lib/unicorn/http_server.rb:562:in `process_client'
unicorn-worker-killer (0.4.4) lib/unicorn/worker_killer.rb:52:in `process_client'
unicorn (5.1.0) lib/unicorn/http_server.rb:658:in `worker_loop'
unicorn (5.1.0) lib/unicorn/http_server.rb:508:in `spawn_missing_workers'
unicorn (5.1.0) lib/unicorn/http_server.rb:519:in `maintain_worker_count'
unicorn (5.1.0) lib/unicorn/http_server.rb:283:in `join'
unicorn (5.1.0) bin/unicorn:126:in `<top (required)>'
/opt/gitlab/embedded/service/gem/ruby/2.3.0/bin/unicorn:22:in `load'
/opt/gitlab/embedded/service/gem/ruby/2.3.0/bin/unicorn:22:in `<top (required)>'
bundler (1.13.7) lib/bundler/cli/exec.rb:74:in `load'
bundler (1.13.7) lib/bundler/cli/exec.rb:74:in `kernel_load'
bundler (1.13.7) lib/bundler/cli/exec.rb:27:in `run'
bundler (1.13.7) lib/bundler/cli.rb:332:in `exec'
bundler (1.13.7) lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
bundler (1.13.7) lib/bundler/vendor/thor/lib/thor/invocation.rb:126:in `invoke_command'
bundler (1.13.7) lib/bundler/vendor/thor/lib/thor.rb:359:in `dispatch'
bundler (1.13.7) lib/bundler/cli.rb:20:in `dispatch'
bundler (1.13.7) lib/bundler/vendor/thor/lib/thor/base.rb:440:in `start'
bundler (1.13.7) lib/bundler/cli.rb:11:in `start'
bundler (1.13.7) exe/bundle:34:in `block in <top (required)>'
bundler (1.13.7) lib/bundler/friendly_errors.rb:100:in `with_friendly_errors'
bundler (1.13.7) exe/bundle:26:in `<top (required)>'
/opt/gitlab/embedded/bin/bundle:22:in `load'
/opt/gitlab/embedded/bin/bundle:22:in `<main>'Output of checks
(If you are reporting a bug on GitLab.com, write: This bug happens on GitLab.com)
Results of GitLab application Check
(For installations with omnibus-gitlab package run and paste the output of:
sudo gitlab-rake gitlab:check SANITIZE=true)
udo gitlab-rake gitlab:check SANITIZE=true
[sudo] password for aj:
Checking GitLab Shell ...
GitLab Shell version >= 4.1.1 ? ... OK (4.1.1)
Repo base directory exists?
default... yes
Repo storage directories are symlinks?
default... no
Repo paths owned by git:git?
default... no
User id for git: 998. Groupd id for git: 998
Try fixing it:
sudo chown -R git:git /var/opt/gitlab/git-data/repositories
For more information see:
doc/install/installation.md in section "GitLab Shell"
Please fix the error above and rerun the checks.
Repo paths access is drwxrws---?
default... yes
hooks directories in repos are links: ...
5/1 ... ok
5/7 ... ok
5/9 ... ok
5/13 ... ok
5/14 ... ok
5/15 ... repository is empty
5/16 ... ok
5/17 ... ok
5/18 ... ok
4/19 ... ok
4/21 ... ok
4/23 ... ok
4/24 ... ok
4/25 ... ok
4/27 ... ok
4/28 ... ok
4/29 ... ok
4/31 ... ok
4/32 ... ok
4/33 ... ok
4/34 ... ok
4/35 ... ok
4/36 ... ok
4/37 ... ok
4/38 ... ok
4/39 ... ok
4/40 ... ok
4/41 ... ok
4/42 ... ok
4/43 ... ok
4/44 ... ok
4/45 ... ok
4/46 ... ok
4/47 ... ok
4/48 ... ok
4/49 ... ok
4/50 ... ok
4/51 ... ok
4/52 ... ok
4/53 ... ok
4/54 ... ok
4/55 ... ok
4/56 ... ok
4/57 ... ok
4/58 ... ok
4/59 ... ok
4/60 ... ok
4/61 ... ok
4/62 ... ok
4/63 ... ok
4/65 ... ok
4/66 ... ok
4/67 ... ok
4/68 ... ok
4/69 ... ok
4/70 ... ok
4/71 ... ok
4/72 ... ok
4/73 ... ok
4/74 ... ok
4/75 ... ok
4/76 ... ok
4/77 ... ok
4/78 ... ok
4/79 ... ok
4/80 ... ok
4/81 ... ok
4/84 ... ok
4/85 ... ok
4/86 ... ok
4/87 ... ok
4/88 ... ok
4/89 ... ok
4/90 ... ok
4/91 ... ok
4/94 ... ok
4/95 ... ok
5/96 ... ok
5/97 ... ok
5/99 ... ok
9/101 ... ok
5/102 ... ok
5/106 ... ok
5/107 ... ok
5/108 ... ok
5/109 ... ok
5/110 ... repository is empty
5/111 ... ok
4/112 ... ok
4/113 ... ok
4/114 ... ok
4/115 ... ok
4/116 ... ok
4/117 ... ok
4/118 ... ok
8/119 ... ok
8/120 ... ok
8/121 ... ok
8/122 ... ok
8/123 ... ok
8/124 ... ok
8/125 ... ok
8/126 ... ok
8/127 ... ok
8/128 ... ok
8/129 ... ok
8/130 ... ok
8/131 ... ok
8/132 ... ok
8/133 ... ok
8/134 ... ok
8/135 ... ok
8/136 ... ok
8/137 ... ok
8/138 ... ok
8/139 ... ok
8/140 ... ok
8/141 ... ok
8/142 ... ok
8/143 ... ok
8/144 ... ok
8/145 ... ok
8/146 ... ok
8/147 ... ok
8/148 ... ok
8/149 ... ok
8/150 ... ok
8/151 ... ok
8/152 ... ok
8/153 ... ok
8/154 ... ok
8/155 ... ok
8/156 ... ok
8/157 ... ok
8/158 ... ok
8/159 ... ok
8/160 ... ok
8/161 ... ok
8/162 ... ok
8/163 ... ok
8/164 ... ok
8/165 ... ok
8/166 ... ok
8/167 ... ok
8/168 ... ok
8/169 ... ok
8/170 ... ok
8/171 ... ok
8/172 ... ok
8/173 ... ok
8/174 ... ok
8/175 ... ok
8/176 ... ok
8/177 ... ok
8/178 ... ok
8/179 ... ok
8/180 ... ok
8/181 ... ok
8/182 ... ok
8/183 ... ok
8/184 ... ok
8/185 ... ok
8/186 ... ok
8/187 ... ok
8/188 ... ok
8/189 ... ok
8/190 ... ok
8/191 ... ok
8/192 ... ok
8/193 ... ok
8/194 ... ok
8/195 ... ok
8/196 ... ok
8/197 ... ok
8/198 ... ok
8/199 ... ok
8/200 ... ok
8/201 ... ok
8/202 ... ok
8/203 ... ok
8/204 ... ok
8/205 ... ok
8/206 ... ok
8/207 ... ok
8/208 ... ok
8/209 ... ok
8/210 ... ok
8/211 ... ok
8/212 ... ok
8/213 ... ok
8/214 ... ok
8/215 ... ok
8/216 ... ok
8/217 ... ok
8/218 ... ok
8/219 ... ok
8/220 ... ok
8/221 ... ok
8/222 ... ok
8/223 ... ok
8/224 ... ok
8/225 ... ok
8/226 ... ok
8/227 ... ok
8/228 ... ok
8/229 ... ok
8/230 ... ok
8/231 ... ok
8/232 ... ok
8/233 ... ok
8/234 ... ok
8/235 ... ok
8/236 ... ok
8/237 ... ok
8/238 ... ok
8/239 ... ok
8/240 ... ok
8/241 ... ok
8/242 ... ok
8/243 ... ok
8/244 ... ok
8/245 ... ok
8/246 ... ok
8/247 ... ok
8/248 ... ok
8/249 ... ok
8/250 ... ok
8/251 ... ok
8/252 ... ok
8/253 ... ok
8/254 ... ok
8/255 ... ok
8/256 ... ok
8/257 ... ok
8/258 ... ok
8/259 ... ok
8/260 ... ok
8/261 ... ok
8/262 ... ok
8/263 ... ok
8/264 ... ok
8/265 ... ok
8/266 ... ok
8/267 ... ok
8/268 ... ok
8/269 ... ok
8/270 ... ok
8/271 ... ok
8/272 ... ok
8/273 ... ok
8/274 ... ok
8/275 ... ok
8/276 ... ok
8/277 ... ok
8/278 ... ok
8/279 ... ok
8/280 ... ok
8/281 ... ok
8/282 ... ok
8/283 ... ok
8/284 ... ok
8/285 ... ok
8/286 ... ok
8/287 ... ok
8/288 ... ok
8/289 ... ok
8/290 ... ok
8/291 ... ok
8/292 ... ok
8/293 ... ok
8/294 ... ok
8/295 ... ok
8/296 ... ok
8/297 ... ok
8/298 ... ok
8/299 ... ok
8/300 ... ok
8/301 ... ok
8/302 ... ok
8/303 ... ok
8/304 ... ok
8/305 ... ok
8/306 ... ok
8/307 ... ok
8/308 ... ok
8/309 ... ok
8/310 ... ok
8/311 ... ok
8/312 ... ok
8/313 ... repository is empty
8/314 ... ok
8/315 ... ok
8/316 ... ok
8/317 ... ok
8/318 ... ok
8/319 ... ok
8/320 ... ok
8/321 ... ok
8/322 ... ok
8/323 ... ok
8/324 ... ok
8/325 ... ok
8/326 ... ok
8/327 ... ok
8/328 ... ok
8/329 ... ok
8/330 ... ok
8/331 ... ok
8/332 ... ok
8/333 ... ok
8/334 ... ok
8/335 ... ok
8/336 ... ok
8/337 ... ok
8/338 ... ok
8/339 ... ok
8/340 ... ok
8/341 ... ok
8/342 ... ok
8/343 ... ok
8/344 ... ok
8/345 ... ok
8/346 ... ok
8/347 ... ok
8/348 ... ok
8/349 ... ok
8/350 ... ok
8/351 ... ok
8/352 ... ok
8/353 ... ok
8/354 ... ok
8/355 ... ok
8/356 ... ok
8/357 ... ok
8/358 ... ok
8/359 ... ok
8/360 ... ok
8/361 ... ok
8/362 ... ok
8/363 ... ok
8/364 ... ok
8/365 ... ok
8/366 ... ok
8/367 ... ok
8/368 ... ok
8/369 ... ok
8/370 ... ok
8/371 ... ok
8/372 ... ok
8/373 ... ok
8/374 ... ok
8/375 ... ok
8/376 ... ok
8/377 ... ok
8/378 ... ok
8/379 ... ok
8/380 ... ok
8/381 ... ok
8/382 ... ok
8/383 ... ok
8/384 ... ok
8/385 ... ok
8/386 ... ok
8/387 ... ok
8/388 ... ok
8/389 ... ok
8/390 ... ok
8/391 ... ok
8/392 ... ok
8/393 ... ok
8/394 ... ok
8/395 ... ok
8/396 ... ok
8/397 ... ok
8/398 ... ok
8/399 ... ok
8/400 ... ok
8/401 ... ok
8/402 ... ok
8/403 ... ok
8/404 ... ok
8/405 ... ok
8/406 ... ok
8/407 ... ok
8/408 ... ok
8/409 ... ok
8/410 ... ok
8/411 ... ok
8/412 ... ok
8/413 ... ok
8/414 ... ok
8/415 ... ok
8/416 ... ok
8/417 ... ok
8/418 ... ok
8/419 ... ok
8/420 ... ok
8/421 ... ok
8/422 ... ok
8/423 ... ok
8/424 ... ok
8/425 ... ok
8/426 ... ok
8/427 ... ok
8/428 ... ok
8/429 ... ok
8/430 ... ok
8/431 ... ok
8/432 ... ok
8/433 ... ok
8/434 ... ok
8/435 ... ok
8/436 ... ok
8/437 ... ok
8/438 ... ok
9/442 ... ok
19/443 ... ok
20/445 ... ok
4/446 ... ok
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Check GitLab API access: OK
Access to /var/opt/gitlab/.ssh/authorized_keys: OK
Send ping to redis server: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Sidekiq ...
Running? ... yes
Number of Sidekiq processes ... 1
Checking Sidekiq ... Finished
Checking Reply by email ...
Reply by email is disabled in config/gitlab.yml
Checking Reply by email ... Finished
Checking LDAP ...
LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab ...
Git configured with autocrlf=input? ... yes
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config outdated? ... no
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory setup correctly? ... yes
Init script exists? ... skipped (omnibus-gitlab has no init script)
Init script up-to-date? ... skipped (omnibus-gitlab has no init script)
projects have namespace: ...
5/1 ... yes
5/7 ... yes
5/9 ... yes
5/13 ... yes
5/14 ... yes
5/15 ... yes
5/16 ... yes
5/17 ... yes
5/18 ... yes
4/19 ... yes
4/21 ... yes
4/23 ... yes
4/24 ... yes
4/25 ... yes
4/27 ... yes
4/28 ... yes
4/29 ... yes
4/31 ... yes
4/32 ... yes
4/33 ... yes
4/34 ... yes
4/35 ... yes
4/36 ... yes
4/37 ... yes
4/38 ... yes
4/39 ... yes
4/40 ... yes
4/41 ... yes
4/42 ... yes
4/43 ... yes
4/44 ... yes
4/45 ... yes
4/46 ... yes
4/47 ... yes
4/48 ... yes
4/49 ... yes
4/50 ... yes
4/51 ... yes
4/52 ... yes
4/53 ... yes
4/54 ... yes
4/55 ... yes
4/56 ... yes
4/57 ... yes
4/58 ... yes
4/59 ... yes
4/60 ... yes
4/61 ... yes
4/62 ... yes
4/63 ... yes
4/65 ... yes
4/66 ... yes
4/67 ... yes
4/68 ... yes
4/69 ... yes
4/70 ... yes
4/71 ... yes
4/72 ... yes
4/73 ... yes
4/74 ... yes
4/75 ... yes
4/76 ... yes
4/77 ... yes
4/78 ... yes
4/79 ... yes
4/80 ... yes
4/81 ... yes
4/84 ... yes
4/85 ... yes
4/86 ... yes
4/87 ... yes
4/88 ... yes
4/89 ... yes
4/90 ... yes
4/91 ... yes
4/94 ... yes
4/95 ... yes
5/96 ... yes
5/97 ... yes
5/99 ... yes
9/101 ... yes
5/102 ... yes
5/106 ... yes
5/107 ... yes
5/108 ... yes
5/109 ... yes
5/110 ... yes
5/111 ... yes
4/112 ... yes
4/113 ... yes
4/114 ... yes
4/115 ... yes
4/116 ... yes
4/117 ... yes
4/118 ... yes
8/119 ... yes
8/120 ... yes
8/121 ... yes
8/122 ... yes
8/123 ... yes
8/124 ... yes
8/125 ... yes
8/126 ... yes
8/127 ... yes
8/128 ... yes
8/129 ... yes
8/130 ... yes
8/131 ... yes
8/132 ... yes
8/133 ... yes
8/134 ... yes
8/135 ... yes
8/136 ... yes
8/137 ... yes
8/138 ... yes
8/139 ... yes
8/140 ... yes
8/141 ... yes
8/142 ... yes
8/143 ... yes
8/144 ... yes
8/145 ... yes
8/146 ... yes
8/147 ... yes
8/148 ... yes
8/149 ... yes
8/150 ... yes
8/151 ... yes
8/152 ... yes
8/153 ... yes
8/154 ... yes
8/155 ... yes
8/156 ... yes
8/157 ... yes
8/158 ... yes
8/159 ... yes
8/160 ... yes
8/161 ... yes
8/162 ... yes
8/163 ... yes
8/164 ... yes
8/165 ... yes
8/166 ... yes
8/167 ... yes
8/168 ... yes
8/169 ... yes
8/170 ... yes
8/171 ... yes
8/172 ... yes
8/173 ... yes
8/174 ... yes
8/175 ... yes
8/176 ... yes
8/177 ... yes
8/178 ... yes
8/179 ... yes
8/180 ... yes
8/181 ... yes
8/182 ... yes
8/183 ... yes
8/184 ... yes
8/185 ... yes
8/186 ... yes
8/187 ... yes
8/188 ... yes
8/189 ... yes
8/190 ... yes
8/191 ... yes
8/192 ... yes
8/193 ... yes
8/194 ... yes
8/195 ... yes
8/196 ... yes
8/197 ... yes
8/198 ... yes
8/199 ... yes
8/200 ... yes
8/201 ... yes
8/202 ... yes
8/203 ... yes
8/204 ... yes
8/205 ... yes
8/206 ... yes
8/207 ... yes
8/208 ... yes
8/209 ... yes
8/210 ... yes
8/211 ... yes
8/212 ... yes
8/213 ... yes
8/214 ... yes
8/215 ... yes
8/216 ... yes
8/217 ... yes
8/218 ... yes
8/219 ... yes
8/220 ... yes
8/221 ... yes
8/222 ... yes
8/223 ... yes
8/224 ... yes
8/225 ... yes
8/226 ... yes
8/227 ... yes
8/228 ... yes
8/229 ... yes
8/230 ... yes
8/231 ... yes
8/232 ... yes
8/233 ... yes
8/234 ... yes
8/235 ... yes
8/236 ... yes
8/237 ... yes
8/238 ... yes
8/239 ... yes
8/240 ... yes
8/241 ... yes
8/242 ... yes
8/243 ... yes
8/244 ... yes
8/245 ... yes
8/246 ... yes
8/247 ... yes
8/248 ... yes
8/249 ... yes
8/250 ... yes
8/251 ... yes
8/252 ... yes
8/253 ... yes
8/254 ... yes
8/255 ... yes
8/256 ... yes
8/257 ... yes
8/258 ... yes
8/259 ... yes
8/260 ... yes
8/261 ... yes
8/262 ... yes
8/263 ... yes
8/264 ... yes
8/265 ... yes
8/266 ... yes
8/267 ... yes
8/268 ... yes
8/269 ... yes
8/270 ... yes
8/271 ... yes
8/272 ... yes
8/273 ... yes
8/274 ... yes
8/275 ... yes
8/276 ... yes
8/277 ... yes
8/278 ... yes
8/279 ... yes
8/280 ... yes
8/281 ... yes
8/282 ... yes
8/283 ... yes
8/284 ... yes
8/285 ... yes
8/286 ... yes
8/287 ... yes
8/288 ... yes
8/289 ... yes
8/290 ... yes
8/291 ... yes
8/292 ... yes
8/293 ... yes
8/294 ... yes
8/295 ... yes
8/296 ... yes
8/297 ... yes
8/298 ... yes
8/299 ... yes
8/300 ... yes
8/301 ... yes
8/302 ... yes
8/303 ... yes
8/304 ... yes
8/305 ... yes
8/306 ... yes
8/307 ... yes
8/308 ... yes
8/309 ... yes
8/310 ... yes
8/311 ... yes
8/312 ... yes
8/313 ... yes
8/314 ... yes
8/315 ... yes
8/316 ... yes
8/317 ... yes
8/318 ... yes
8/319 ... yes
8/320 ... yes
8/321 ... yes
8/322 ... yes
8/323 ... yes
8/324 ... yes
8/325 ... yes
8/326 ... yes
8/327 ... yes
8/328 ... yes
8/329 ... yes
8/330 ... yes
8/331 ... yes
8/332 ... yes
8/333 ... yes
8/334 ... yes
8/335 ... yes
8/336 ... yes
8/337 ... yes
8/338 ... yes
8/339 ... yes
8/340 ... yes
8/341 ... yes
8/342 ... yes
8/343 ... yes
8/344 ... yes
8/345 ... yes
8/346 ... yes
8/347 ... yes
8/348 ... yes
8/349 ... yes
8/350 ... yes
8/351 ... yes
8/352 ... yes
8/353 ... yes
8/354 ... yes
8/355 ... yes
8/356 ... yes
8/357 ... yes
8/358 ... yes
8/359 ... yes
8/360 ... yes
8/361 ... yes
8/362 ... yes
8/363 ... yes
8/364 ... yes
8/365 ... yes
8/366 ... yes
8/367 ... yes
8/368 ... yes
8/369 ... yes
8/370 ... yes
8/371 ... yes
8/372 ... yes
8/373 ... yes
8/374 ... yes
8/375 ... yes
8/376 ... yes
8/377 ... yes
8/378 ... yes
8/379 ... yes
8/380 ... yes
8/381 ... yes
8/382 ... yes
8/383 ... yes
8/384 ... yes
8/385 ... yes
8/386 ... yes
8/387 ... yes
8/388 ... yes
8/389 ... yes
8/390 ... yes
8/391 ... yes
8/392 ... yes
8/393 ... yes
8/394 ... yes
8/395 ... yes
8/396 ... yes
8/397 ... yes
8/398 ... yes
8/399 ... yes
8/400 ... yes
8/401 ... yes
8/402 ... yes
8/403 ... yes
8/404 ... yes
8/405 ... yes
8/406 ... yes
8/407 ... yes
8/408 ... yes
8/409 ... yes
8/410 ... yes
8/411 ... yes
8/412 ... yes
8/413 ... yes
8/414 ... yes
8/415 ... yes
8/416 ... yes
8/417 ... yes
8/418 ... yes
8/419 ... yes
8/420 ... yes
8/421 ... yes
8/422 ... yes
8/423 ... yes
8/424 ... yes
8/425 ... yes
8/426 ... yes
8/427 ... yes
8/428 ... yes
8/429 ... yes
8/430 ... yes
8/431 ... yes
8/432 ... yes
8/433 ... yes
8/434 ... yes
8/435 ... yes
8/436 ... yes
8/437 ... yes
8/438 ... yes
9/442 ... yes
19/443 ... yes
20/445 ... yes
4/446 ... yes
Redis version >= 2.8.0? ... yes
Ruby version >= 2.1.0 ? ... yes (2.3.3)
Your git bin path is "/opt/gitlab/embedded/bin/git"
Git version >= 2.7.3 ? ... yes (2.8.4)
Active users: 16
Checking GitLab ... FinishedResults of GitLab environment info
System information
System: Ubuntu 16.04
Current User: git
Using RVM: no
Ruby Version: 2.3.3p222
Gem Version: 2.6.6
Bundler Version:1.13.7
Rake Version: 10.5.0
Sidekiq Version:4.2.7
GitLab information
Version: 8.15.2-ee
Revision: aa95861
Directory: /opt/gitlab/embedded/service/gitlab-rails
DB Adapter: PostgreSQL
DB Version: 9.2.18
URL: https://git.daplie.com
HTTP Clone URL: https://git.daplie.com/some-group/some-project.git
SSH Clone URL: git@git.daplie.com:some-group/some-project.git
Elasticsearch: no
Geo: no
Using LDAP: no
Using Omniauth: yes
Omniauth Providers: github, gitlab, twitter
GitLab Shell
Version: 4.1.1
Repository storage paths:
- default: /var/opt/gitlab/git-data/repositories
Hooks: /opt/gitlab/embedded/service/gitlab-shell/hooks/
Git: /opt/gitlab/embedded/bin/gitPossible fixes
No idea, but my workaround is to use a script to check for 500 errors and rerun this:
sudo restart-on-fail.shrestart-on-fail.sh:
#!/bin/bash
echo
echo
echo "GitLab Watchdog Running"
while true
do
RESULT=$(curl -is https://git.daplie.com/Daplie/node-greenlock | grep 'HTTP/1.1 500')
if [ -n "$RESULT" ]
then
sleep 2
RESULT=$(curl -is https://git.daplie.com/Daplie/node-greenlock | grep 'HTTP/1.1 500')
echo
echo $RESULT
echo
if [ -n "$RESULT" ]
then
echo
echo Down at $(date "+%F %H:%M:%S")
gitlab-ctl stop
gitlab-ctl start
# gitlab-ctl tail
echo Waiting...
sleep 60
echo Checking...
fi
fi
sleep 5
doneEdited by 🤖 GitLab Bot 🤖