Show more info about pending pods for kubernetes runners
We are using the kubernetes executor for running ci job with GitLab. We often see the following in the logs of the jobs before the build begins:
Waiting for pod gitlab-runner/<...> to be running, status is Pending
ContainersNotReady: "containers with unready status: [build helper]"
ContainersNotReady: "containers with unready status: [build helper]"
We would like to speed up the jobs and need to debug why pods are pending for so long.
This is currently only possible while the job is running via kubectl describe pod ...
.
We identified that most often the pods are pulling a container image (which takes very long because of docker hub's rate limiting) and that's why they are pending for so long.
But this is not visible to the developers which triggered the job.
I think it would be nice to also show why a pod is pending in the logs of the ci job.
I think it should also be possible to define a separate timeout for pulling images.