Switch from background jobs to using tasks

We want to finally move from Sidekiq background jobs for indexing or deletion to the Tasks approach for the following main reasons:

  • To avoid blocking Sidekiq.
  • Indexer will be able to control its own concurrency. Right now, Rails has no idea if the indexer can accept more indexing operations.
  • We can communicate with the indexer omnidirectional instead of bidirectional, simplifying the overall architecture.
Edited by Ravi Kumar