2025-12-04: Chef Converge Failures for Runner Managers

Chef Converge Failures for Runner Managers (Severity 3)

Problem: Chef converge processes were failing on several runner manager VMs and a few others.

Impact: Several runner manager VMs and about 3 other VMs were unable to converge, risking Chef being a blocker during other incidents.

Causes: The firewall cookbook was upgraded from version 2.5.4 to 2.7.1, which triggered Chef converge failures.

Response strategy: We removed the firewall 2.7.1 cookbook from the Chef server, and systems are now recovering.

---

This ticket was created to track INC-6098, by incident.io 🔥