Warning when failed jobs

Note: This may belong in a different repo and if so, I'm happy to repost it to a better place

Description

I have a few repos with CI jobs that are allowed to fail. Mostly around beginning to implement new code linters in existing projects. I can mark the job as allowed to fail in .gitlab-ci.yml, but that doesn't actually show me that the job has finished. Also, if I choose to auto-merge the MR when the build succeeds, the jobs that are allowed to fail don't stop the auto-merge.

Proposal

I would propose that there needs to be a third result from CI jobs: succeeded, failed, and warned. Warned jobs would prevent auto-merge and show a yellow warning when looking at the pipeline to signify that the job failed, but it is allowed by configuration. A warned job would not stop the next stages of a pipeline from running, but it would stop auto-merge from happening to give engineers time to respond to the warning.

Documentation blurb

Jobs allowed to fail, but that can't be auto-merged in merge requests are useful when testing new tools in CI. Configuration can be something like:

allow_failure: true
merge_on_failure: false