Increase throughput of ElasticIndexBulkCronWorker
We only run ElasticIndexBulkCronWorker
once per minute. With our plans to use ZSETs for initial and incremental updates this can easily become a bottleneck.
My suggestion is to add a condition to reschedule the same worker if we have more than LIMIT
jobs queued to keep processing jobs after an initial cron job is finished.