Investigate why so much Redis Persistent traffic comes from Sidekiq::Stats

About 20% of all Redis-persistent traffic comes from Sidekiq commands that are only issued from Sidekiq::Stats

These commands are:

sscan resque:gitlab:queues
sscan resque:gitlab:processes
hget resque:gitlab:<host>:*:*
hgetall resque:gitlab:cron_job:*

In a 30 second traffic sample, these calls made up 18% of all traffic.

All of these commands are issued from the Sidekiq::Stats class: https://github.com/mperham/sidekiq/blob/master/lib/sidekiq/api.rb

The question is: why do so many of these calls get issued from the application?

Reducing this traffic would have a big impact on our Redis usage.

Edited by Andrew Newdigate