Skip to content

docker /dev/shm is too small to hold all the metrics

Description:

When i gitlab upgrade from 12.4.3 to 13.1.1 encountered error from gitlab log.

  • Gitlab server information:

    GitLab13.1.1-ee (a604fffd4ba)
    GitLab Shell13.3.0
    GitLab Workhorsev8.35.0
    GitLab APIv4
    GitLab Pages1.18.0
    Ruby2.6.6p146
    Rails6.0.3.1
    PostgreSQL11.7
  • Gitlab instance service

    $ gitlab-ctl status
    
    run: alertmanager: (pid 2736) 77921s; run: log: (pid 1046) 77958s
    run: gitaly: (pid 249) 78033s; run: log: (pid 398) 78030s
    run: gitlab-exporter: (pid 885) 77979s; run: log: (pid 895) 77975s
    run: gitlab-pages: (pid 805) 77991s; run: log: (pid 839) 77988s
    run: gitlab-workhorse: (pid 2591) 77922s; run: log: (pid 657) 78008s
    run: grafana: (pid 2776) 77920s; run: log: (pid 2023) 77946s
    run: logrotate: (pid 23269) 2384s; run: log: (pid 787) 77996s
    run: nginx: (pid 684) 78003s; run: log: (pid 763) 78000s
    run: postgres-exporter: (pid 2767) 77920s; run: log: (pid 1072) 77954s
    run: postgresql: (pid 477) 78027s; run: log: (pid 596) 78024s
    run: prometheus: (pid 2668) 77921s; run: log: (pid 987) 77966s
    run: puma: (pid 600) 78021s; run: log: (pid 607) 78020s
    run: redis: (pid 234) 78039s; run: log: (pid 241) 78038s
    run: redis-exporter: (pid 2651) 77922s; run: log: (pid 912) 77970s
    run: registry: (pid 36335) 35720s; run: log: (pid 881) 77982s
    run: sidekiq: (pid 29450) 18710s; run: log: (pid 627) 78012s
    run: sshd: (pid 25) 78054s; run: log: (pid 24) 78054s
  • Error log

    $ cat /var/log/gitlab/gitlab-rails/production.log
    
    writing value to /dev/shm/gitlab/sidekiq/gauge_all_sidekiq_0-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/gauge_all_sidekiq_0-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/gauge_all_sidekiq_0-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/sidekiq/histogram_sidekiq_0-0.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file
    writing value to /dev/shm/gitlab/puma/histogram_puma_5-1.db failed with unmapped file

    gitlab-error

    gitlab-error2

Edited by DJ Mountney