Corrective Action: Inject a small subset of QA tests within staging-canary deployment after pre migrations
Problem
This incident was caused by a migration that created incompatibilities and was not captured by QA tests within staging-canary
Proposed Solution
To increase the likelihood of capturing related issues, we need to inject an additional run of at least one spec that helps expose this error. To do so, we would need to execute a partial run of QA specs that are tagged :db_migration
just after migrations are first applied to staging-canary
, but before any application upgrades. This will help maximize the chance of creating the incompatibility that this type of spec would expose.