Preparation failed: Error: No such image

Summary

When attempting to pull the image mingc/android-build-box:latest on a Shared Runner, you are met with an error message:

ERROR: Preparation failed: Error: No such image: mingc/android-build-box:latest (docker.go:205:0s)

The error message seems to indicate there is no such image, however, you can pull the image directly on a local machine without any issues. We can see that the image is available on Docker Hub and downloading while using the :latest tag. In speaking with @tmaczukin and @ajwalker, it seems that the error "Error: No such image" is expected because the image doesn't exist locally, as the pull failed. We don't pass any other information to determine if something else happened prior. Some additional thoughts:

  • The image is large, about ~5.5GB. Another issue points to perhaps some sort of space issue
  • If size an issue, what is the current image size and/or memory size limitation on our shared runners?
  • Can we pass an error message that can identify what the actual point of failure is?
  • The image pulls in about 20 minutes and does not reach any sort of timeout limit for jobs
  • This was working previously, but you can consistently replicate by retrying the job

Steps to reproduce

  1. Create a .gitlab-ci.yml with image: mingc/android-build-box:latest
  2. Check the latest pipeline to see if it fails to pull
  3. Try using any other tag such as mingc/android-build-box:1.15.0
  4. Note that any other tag also fails to pull
  5. Attempt to pull on your local machine by doing docker pull mingc/android-build-box:latest
  6. Note that it pulls without issue consistently

Example Project

https://gitlab.com/gitlab-silver/android-build-box/-/jobs/556915168

What is the current bug behavior?

Pulling the image mingc/android-build-box:latest fails saying that it does not exist.

What is the expected correct behavior?

We should see an error message providing detail why it was not able to pull, or what limitation has been reached.

Relevant logs and/or screenshots

 Running with gitlab-runner 13.0.0-rc1 (f319718d)
   on docker-auto-scale 72989761
Preparing the "docker+machine" executor
19:51
 Using Docker executor with image mingc/android-build-box:latest ...
 Pulling docker image mingc/android-build-box:latest ...
 ERROR: Preparation failed: Error: No such image: mingc/android-build-box:latest (docker.go:205:0s)
 Will be retried in 3s ...
 Using Docker executor with image mingc/android-build-box:latest ...
 Pulling docker image mingc/android-build-box:latest ...
 ERROR: Preparation failed: Error: No such image: mingc/android-build-box:latest (docker.go:205:0s)
 Will be retried in 3s ...
 Using Docker executor with image mingc/android-build-box:latest ...
 Pulling docker image mingc/android-build-box:latest ...
 ERROR: Preparation failed: Error: No such image: mingc/android-build-box:latest (docker.go:205:0s)
 Will be retried in 3s ...
 ERROR: Job failed (system failure): Error: No such image: mingc/android-build-box:latest (docker.go:205:0s)

Output of checks

This happens on GitLab.com 13.0.0-pre 54bf0a42

ZD Ticket (Internal):

Edited by Arran Walker