Praefect service takes too much memory
Summary
Hi sir,
Recently our customer found that their Praefect service took too much memory after long time use, the machine's total memory size is 64GB, Praefect service itself took about 40~50GB. They are using GitLab HA cluster which is serving 1000~2000 developers.
The temporary solution is to restart Praefect service with gitlab-ctl command. Then the memory usage is normal.
Could you please give us some advices about how to dig the root cause?
Thanks!
Steps to reproduce
After long use of Praefect service.
What is the current bug behavior?
Praefect service takes too much memory.
What is the expected correct behavior?
Praefect service should not takes too much memory.
Relevant logs
None
Details of package version
Provide the package version installation details
gitlab-ee-13.5.7
Environment details
- Operating System: Debian 9
- Installation Target, remove incorrect values:
- Bare Metal Machine
- Installation Type, remove incorrect values:
- Upgrade from version 13.4.0 four months ago
- Is there any other software running on the machine:
- Consul server+Pgbouncer+Patroni+Postgresql, they run on the same machine with Praefect.
- Is this a single or multiple node installation?
- Multiple node
- Resources
- CPU: 32 cores
- Memory total: 64GB
Configuration details
Provide the relevant sections of `/etc/gitlab/gitlab.rb`
Edited by Alex Ju