Skip to content

Investigate cause of Releases::CreateEvidenceWorker spike

Overview

During production#19720 (closed) we noticed a large spike of Releases::CreateEvidenceWorker jobs.

image

Source

Accompanied by a drop in RPS to redis image

These jobs also seemed to be quite long in db_duration

image

source

We believe these slow jobs caused a pile up in pgbouncer, and are what caused the dip in sidekiq SLI

image

source

Goal

What we are looking to understand is what caused this pile up of slow jobs, and if it is likely to happen again.

This ticket was created from INC-584 and was automatically exported by incident.io 🔥

Edited by Sarah Walker