Track the dynamic concurrency limit in Redis

ConcurrencyLimit currently only supports having static limit defined in worker attribute.

Since we will dynamically adjust the concurrency limit with AIMD in gitlab-com/gl-infra/observability/team#3815 (comment 2188997620), the limit has to be tracked globally across all Sidekiq processes and stored in Redis.

Edited Apr 25, 2025 by Marco Gregorius

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information