Add node.task_count to internalAPI

Dmitry Gruzdrequested to merge
add-task-count into main

What does this MR do and why?

This MR adds task_count as a new internalAPI parameter. We'll need it to decide how many jobs to give to the indexer from GitLab to avoid indexing saturation.

Related to Zoekt Sharding and Replication (&11382 - closed)

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

  1. Export GDK_DIR 
    export GDK_DIR=<PATH_TO_GDK>
  2. Execute Zoekt indexer in GDK mode 
    make gdk
  3. Tail log/development.log
  4. Verify that you see node.task_count as a parameter for /api/v4/internal/search/zoekt/<UUID>/tasks
  5. It will be 0 if you don't have in-progress indexing operations, but you can try to time an indexing request to see how it increments
Edited by Dmitry Gruzd

Merge request reports