2025-09-11: staging PDM failed with CheckViolation error

staging PDM failed with CheckViolation error (Severity 4 (Low))

Problem: A post-deploy migration job in staging failed with a PG::CheckViolation error related to the integrations table migration.

Impact: Deployments were blocked in the staging environment until the failed migration was addressed.

Causes: Some records in the integrations table did not meet the not-null constraint due to having multiple sharding keys set. A prior backfill did not correct all invalid records, resulting in a constraint violation when the migration was applied.

Response strategy: We marked the migration as successfully executed on both gstg and gprd environments after confirmation from database operations. The failed migration job in staging was retried and succeeded. The migration that introduced the sharding key was reverted and merged to prevent further issues. The incident is now closed as staging deployments are unblocked.

---

This ticket was created to track INC-3860, by incident.io 🔥