Add prometheus metric for active context queue sizes

Madelein van Niekerkrequested to merge
569746/report-queue-size into master

What does this MR do and why?

Adds a prometheus metric to report ActiveContext queue sizes. It is one gauge with labels for every queue along with the count. I added it to the GlobalSearchSampler since the Global Search team will own the infrastructure of ActiveContext.

Also removes the Advanced Search metrics that were marked for deprecation while we're here.

Next: if the metric is reporting, we can add a tile to an existing or new dashboard similar to what we have for Advanced Search:

image

References

#569746 (comment 2883000936)

How to set up and validate locally

  1. Add some refs to the code queue Ai::ActiveContext::Collections::Code.track!({id: "hash123", routing: 1})
  2. ::Ai::ActiveContext::MetricsUpdateService.new.execute
  3. Get the values of the metric: Prometheus::Client.registry.get(:active_context_queue_size).values
  4. Clear the queues Ai::ActiveContext::Queues::Code.clear_tracking!
  5. ::Ai::ActiveContext::MetricsUpdateService.new.execute
  6. Get the values of the metric: Prometheus::Client.registry.get(:active_context_queue_size).values

MR acceptance checklist

Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

Merge request reports