2026-05-18: Jobs not being picked up/stuck pending (runner/sidekiq issue?)
# Jobs not being picked up/stuck pending (runner/sidekiq issue?) (Severity 3) **Problem**: CI jobs assigned to medium, large, xlarge, and 2xlarge runner shards were stuck pending and not being picked up due to capacity issues. **Impact**: Multiple internal and external customers experienced delays as CI jobs assigned to medium, large, xlarge, and 2xlarge runner shards were stuck pending. Queue times and pending job durations increased until the mitigation steps were rolled out. **Causes**: VM stockout issues on N2D machine types prevented job processing for medium, large, xlarge, and 2xlarge runner shards. Small shards were previously migrated to N4-standard-2 instances and were not affected. **Response strategy**: We migrated medium, large, xlarge, and 2xlarge runner shards to N4-standard instances with updated disk settings. Shared-gitlab-org runners were also migrated. Job pickup rates have improved, queues are trending downward, and we are monitoring to confirm full recovery. _This ticket was created to track_ [_INC-10215_](https://app.incident.io/gitlab/incidents/10215)_, by_ [_incident.io_](https://app.incident.io) 🔥
issue