Increase throughput of ElasticIndexBulkCronWorker

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

• Close this issue

We only run ElasticIndexBulkCronWorker once per minute. With our plans to use ZSETs for initial and incremental updates this can easily become a bottleneck.

My suggestion is to add a condition to reschedule the same worker if we have more than LIMIT jobs queued to keep processing jobs after an initial cron job is finished.