`wget: write error: No space left on device` on gitlab-shared-runners-manager-4.gitlab.com (#157329)
We experienced this error this morning in our `master` pipelines for `gitlab-org/gitlab`: https://gitlab.com/gitlab-org/gitlab/-/jobs/458606052 ``` 1 Running with gitlab-runner 12.8.0 (1b659122) 2 on docker-auto-scale-com 9538b0ab 3 Using Docker executor with image registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.6.5-golang-1.12-git-2.24-lfs-2.9-chrome-73.0-node-12.x-yarn-1.21-postgresql-9.6-graphicsmagick-1.3.34 ... 00:07 4 Starting service postgres:9.6.17 ... 5 Pulling docker image postgres:9.6.17 ... 6 Using docker image sha256:0f9aa94007740b54238a4bfd881130b04a7c96ac1c0edfc8c1a7a8d14f3ebf55 for postgres:9.6.17 ... 7 Starting service redis:alpine ... 8 Pulling docker image redis:alpine ... 9 Using docker image sha256:b68707e68547e636f2544e9283f02beed46d536f644573c8b35c368f9abbe078 for redis:alpine ... 10 Waiting for services to be up and running... 11 Authenticating with credentials from job payload (GitLab Registry) 12 Pulling docker image registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.6.5-golang-1.12-git-2.24-lfs-2.9-chrome-73.0-node-12.x-yarn-1.21-postgresql-9.6-graphicsmagick-1.3.34 ... 13 Using docker image sha256:0f9ca78298a31444537de457edb9067ada5eff69e276ed8949386f35b3760183 for registry.gitlab.com/gitlab-org/gitlab-build-images:ruby-2.6.5-golang-1.12-git-2.24-lfs-2.9-chrome-73.0-node-12.x-yarn-1.21-postgresql-9.6-graphicsmagick-1.3.34 ... 15 Running on runner-9538b0ab-project-278964-concurrent-0 via runner-9538b0ab-gsrm-1583302999-a45df5ff... 00:02 17 $ eval "$CI_PRE_CLONE_SCRIPT" 00:00 18 Downloading archived master... 19 Connecting to storage.googleapis.com (172.253.123.128:443) 20 gitlab.tar.gz 7% |** | 59.2M 0:00:13 ETA 21 gitlab.tar.gz 47% |*************** | 401M 0:00:02 ETA 22 gitlab.tar.gz 48% |*************** | 411M 0:00:03 ETA 23 gitlab.tar.gz 63% |******************** | 536M 0:00:02 ETA 24 gitlab.tar.gz 76% |************************ | 648M 0:00:01 ETA 25 wget: write error: No space left on device 30 ERROR: Job failed (system failure): Error response from daemon: symlink ../aad560b0375b599013c6cb849b7e87d0d527c0791941d8dbdf8bb5b26c827dfc-init/diff /var/lib/docker/overlay2/l/AITEJAWUOLBSBIUSH6HRJEOAEY: no space left on device (executor_docker.go:716:0s) ```
issue