2025-09-08: Production Post Deployment Migration failed

Production Post Deployment Migration failed (Severity 4 (Low))

Problem: A production post deployment migration failed due to database lock timeouts.

Impact: Deployments and other migrations were blocked until the failed migration was marked as executed.

Causes: A migration script (20250812153148_remove_fk_from_mrdc.rb) failed to acquire a database lock on a busy table, resulting in repeated timeouts.

Response strategy: We marked the failed migration as executed to unblock deployments and notified the #f_upcoming_release channel. A follow-up has been created to develop and schedule a replacement migration with improved lock retry logic.

---

This ticket was created to track INC-3776, by incident.io 🔥