Zoekt: Reduce zoekt_nodes frequent update

Ravi Kumarrequested to merge
499124-reduce-nodes-update into master

What does this MR do and why?

There are two changes:

  • Adjust the tasks pull frequency based on the number of pending tasks. If the number of pending tasks is more than the concurrency limit of a node then the pull frequency will be 500ms else it will be 10s. This will optimize the pulling of tasks.
  • Save the node only when the updated_at is older than 5s. This will reduce the zoekt_nodes update load.

Related: #499124 (closed)

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Screenshots or screen recordings

Screenshots are required for UI changes, and strongly recommended for all other merge requests.

Before After

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Edited by Ravi Kumar

Merge request reports