Skip to content

Add llm-completion SLI to Sidekiq

Bob Van Landuyt requested to merge bvl/llm-completion-sli into master

Add llm-completion SLI to Sidekiq

This adds the llm-completion SLI to the sidekiq service. This SLI should eventually move to the AI gateway, but as the AI gateway is currently not yet involved in these operations, this adds it to the Sidekiq service that emits the metrics.

For gitlab-com/gl-infra/scalability#2507 (closed)

Snapshot of sidekiq dashboard: https://dashboards.gitlab.net/dashboard/snapshot/qDFuz0hMHnAs20pex56N9v7hbYzMa2g1?orgId=1
Expand SLI Details: llm_completion to see anything as the recordings for the other panels aren't yet there.

Edited by Bob Van Landuyt

Merge request reports