Post-deployment monitoring (continuous verification) MVC
Problem to Solve
Continuous deployment should be easy and boring. One thing that makes it more comfortable is to have monitoring to measure service-level objectives and the impact on those SLOs of an individual deploy. When doing an automatic incremental deploy (#1660 (closed)) or canary deploy (#1659 (closed)), we should be able to use these measurements to automatically halt a deploy and even revert/rollback.
Scenario: Incremental rollout, notices error rate exceeds SLO of 0.1%, aborts rollout at 1%, and reverts to last-known-good version.