According to the docs, allow_failure: false is needed to make a job blocking
allow_failure: false
https://docs.gitlab.com/ee/ci/yaml/#whenmanual
Fixes gitlab-org/gitlab#36917 (closed)