Skip to content

Investigate possibility of having a redis instance per Sidekiq queue

In the sync call regarding the plan per Redis instance, an option was put forward to consider having separate instances per Sidekiq queue.

For this exercise, please set aside a finite amount of time to consider the following questions:

  1. When would a queue get it's own instance? Would it need to have certain characteristics?
  2. What happens when a queue is too big for an instance and how far away is that really?
  3. What are the operability concerns of having that many instances?
  4. How could setting up an instance be passed over to the development teams or how could we involve them further in some way?
Edited by Rachel Nienaber