allow_failure:exit_codes unusable with custom executor because exit code is always 1

Status update 9-11-23 (%16.6)

Executors other than shell work. Shell can be fixed with FF_USE_NEW_BASH_EVAL_STRATEGY: #28658 (comment 1641057165)

Summary

Jobs running on gitlab-runner using the custom executor will exit with code 1 instead of the failing exit code from the script.

Steps to reproduce

• Try set exit_codes: 50 and run "exit 50" on custom executor.

• The job will fail with "ERROR: Job failed: exit status 1"

Note: The docs do not mention any way to pass exit code back to gitlab. Only BUILD_FAILURE_EXIT_CODE, SYSTEM_FAILURE_EXIT_CODE and 0 are valid exit code

See related comment here

.gitlab-ci.yml

Add the job definition that is failing here

Actual behavior

Expected behavior

Relevant logs and/or screenshots

job log

Add the job log

Environment description

config.toml contents

Add your configuration here

Used GitLab Runner version

Possible fixes