Skip to content

Use ArchiveTraceWorker in ArchiveTracesCronWorker

Shinya Maeda requested to merge use-archive-trace-worker-in-cron-worker into master

What does this MR do?

Currently, ArchiveTracesCronWorker (Sidekiq Cron Worker) consumes 1.5~3 GB of memory constantly thus being killed by Sidekiq Memory Killer often. And in this case, the sidekiq job is respawn multiple times in a short interval, for instance, you can see the inconsistent behavior in https://log.gitlab.net/goto/d1432992d790cbaf2744427bd020216f

We should avoid this behavior by splitting archive jobs into individual sidekiq worker. We already have ArchiveTraceWorker for this usage.

Does this MR meet the acceptance criteria?

Conformity

Performance and testing

Security

If this MR contains changes to processing or storing of credentials or tokens, authorization and authentication methods and other items described in the security review guidelines:

  • Label as security and @ mention @gitlab-com/gl-security/appsec
  • The MR includes necessary changes to maintain consistency between UI, API, email, or other methods
  • Security reports checked/validated by a reviewer from the AppSec team
Edited by Shinya Maeda

Merge request reports