Send the unique project_id task to the Zoekt indexer in the tasks API
Background
Currently, In the Task API, we don't have optimal throughput. One factor could be that we are not sending distinct project tasks in the GET
tasks API. With the same projects, the issue could be that the Zoekt indexer has to skip the same projects because it will get the indexing lock error. This means in one call the zoekt indexer actually processes fewer tasks than it actually could process.
Proposal
Here https://gitlab.com/gitlab-org/gitlab/-/blob/e0f67c74ecba7d414f5fabc9c32cdfcddd4d9648/ee/app/models/search/zoekt/task.rb#L64 Send tasks with a unique project_identifier
Edited by Ravi Kumar