Support manual override of failed jobs to distinguish expected from unexpected failures - Add a manual option to allow_failure

Everyone can contribute. Help move this issue forward while earning points, leveling up and collecting rewards.

Description

I have jobs triggered by a pushed tag. Some of the jobs may fail, like the deployment, if they have been deployed manually before the pipeline runs (cannot deploy twice on Pypi). Adding allow_failure doesn't raise any problem and everything seems to be fine, which is a problem.

I need the pipeline to fail if it fails to deploy, but I still want to be able to check on my side if things are ok, then manually override the job to allow a failure.

Proposal

In gitlab-ci, allow_failure should accept the value manual. When set to manual, if this job fails we can manually click on it and select "allow_failure".

job1:
  stage: test
  script:
  - execute_script_that_may_fail
  allow_failure: manual

Right now, if that happens, we would need to modify the gitlab-ci file to add allow_failure just for this build and remove it after.

Edited by Rutvik Shah