Skip to content

Gitlab runner system failure

Summary

CI jobs fail on the start due to "runner system failure". It happens quite often for the last day.

Steps to reproduce

Trigger any pipeline run (this happens randomly).

Actual behavior

The job is failed. The warning banner is showed: There has been a runner system failure, please try again

Expected behavior

The job is started successfully.

Relevant logs and/or screenshots

job log
Running with gitlab-runner 15.11.0 (436955cb)
  on i-092867ece63dca76c-in-767914017133-at-us-east-1 -xFz-2z-, system ID: s_875ea15a3b64
Resolving secrets
00:00
Preparing the "docker" executor
00:03
Using Docker executor with image registry.gitlab.com/<somePath> ...
Authenticating with credentials from job payload (GitLab Registry)
Pulling docker image registry.gitlab.com/<somePath> ...
Using docker image sha256:<someSHA> for registry.gitlab.com/<somePath> with digest registry.gitlab.com/<somePath>@sha256:<someSHA> ...
Preparing environment
00:01
ERROR: Job failed (system failure): prepare environment: Error response from daemon: error while creating mount source path '/mnt/orchlib': mkdir /mnt/orchlib: file exists (exec.go:78:0s). Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information

Environment description

gitlab SAAS; shared runners.

Runner example:

#22957783 (-xFz-2z-F) i-092867ece63dca76c-in-767914017133-at-us-east-1

labels: amd64, computetype-ondemand, glexecutor-docker, group:shared, linux, po, precision-oncology, test

Used GitLab Runner version

Running with gitlab-runner 15.11.0 (436955cb)
  on i-092867ece63dca76c-in-767914017133-at-us-east-1 -xFz-2z-, system ID: s_875ea15a3b64

-->

Possible fixes

Restart the job.