Skip to content

Adds probe_future_sets to report on delays in scheduled and retry sets

Craig Miskell requested to merge future-sets-metrics2 into master

A long description is available at gitlab-com/gl-infra/scalability#1171 (closed) but in short, this now reports how far "behind" Sidekiq is in processing the Scheduled or Retry sets; jobs in those sets are expected to normally be processed within a short time (seconds, not minutes) of their nominal scheduled time, but in bad times we can sometimes get behind, and being able to observe the magnitude of the backlog is desirable.

Adds both a delay time metric (how old is the next job that will be processed) and a backlog count (how many jobs are pending)

Will need a rebase from master once https://gitlab.com/gitlab-org/gitlab-exporter/-/merge_requests/146 is merged; if testing locally it requires that MR (or something similar) in order to function.

Merge request reports