Auto DevOps 'performance' stage is executed before a manual deployment to production
Problem
Auto DevOps performance
stage is executed to get metrics from a production deployment. This works correctly in the default workflow, where continuous deployment is used and production
is a standard job.
The problem comes if you decide to implement a different deploy policy, making production
job manual (as described in the template), or if you want to use incremental rollouts. With those options, the production_manual
job and all the rollout N%
jobs are set as when: manual
, that by default makes the job allow_failure: true
.
Having those manual actions optional, the performance
job doesn't wait for them and run without a production deployment. This will give no results.
Solution
Make production_manual
and rollout 100%
jobs explicitly set to allow_failure: false
.
In this way, the pipeline will block waiting for the manual deployment to production
, and after that performance
will run.