You need to sign in or sign up before continuing.
After unmounting /cache, project downloads are filling up the directory on api nodes
Noted by @cmiskell in gitlab-com/gl-infra/production#1238 (comment 258351033)
We have to roll back the unmounting of
cache
, as project downloads are piling up in the root volume of the api-cny nodes (~12GB each as at this writing, and at about 95% full). Whatever process cleans these up presumably doesn't know to go looking on each individual API node, and assumes there's a shared repository (but this is speculation only). Perhaps Object Storage is the solution here?
Currently /var/opt/gitlab/gitlab-rails/shared/cache
is shared between the front and the backend by an NFS mount, it appears that files are cached here on the api without being cleaned up, perhaps this is done by a sidekiq job?
Edited by John Jarvis