Skip to content

Add weight/priority to queue groups

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

Proposal

When working with a customer for routing rules we noticed that their rails node would pick up jobs before their sidekiq nodes. They have a specific rule for their rails nodes but this still includes roughly 500 queues.

## Routing rules
sidekiq['routing_rules'] = [
  ['feature_category!=global_search,container_registry,value_stream_management,code_testing&resource_boundary!=cpu&urgency=high', 'rails-node'],
  ['*', 'default']
]

This results in their Sidekiq nodes doing almost nothing while their Rails nodes handle the most jobs.

My proposal is adding a weight/priority for queue groups to regulate where the jobs are going more clearly.

## Rails
sidekiq['queue_groups'] = [
 'rails-node&priority=2',
 'rails-node&priority=2'
]

## Sidekiq
sidekiq['queue_groups'] = [
 'rails-node&priority=1',
 'rails-node&priority=1',
 'default',
 'default,mailers'
] 

This would prioritize the Sidekiq nodes over the Rails nodes using the Rails node as a backup.

Ticket https://gitlab.zendesk.com/agent/tickets/531724 (internal only)

Edited by 🤖 GitLab Bot 🤖