Skip to content

prometheus pods stuck in Pending on the zonal staging clusters

After configuring all three zonal clusters for the first time, prometheus pods are stuck in pending:

prometheus-gitlab-monitoring-promethe-prometheus-0      0/4     Pending   0          19h
prometheus-gitlab-monitoring-promethe-prometheus-1      0/4     Pending   0          15h

This looks like a provisioning error:

us-east1-b

3m38s       Warning   ProvisioningFailed   persistentvolumeclaim/prometheus-gitlab-monitoring-promethe-prometheus-db-prometheus-gitlab-monitoring-promethe-prometheus-0   Failed to provision volume with StorageClass "standard-regional-east1": kubernetes does not have nodes in specified zones: map["us-east1-c":{} "us-east1-d":{}]. Zones that contain nodes: map["us-east1-b":{}]
3m38s       Warning   ProvisioningFailed   persistentvolumeclaim/prometheus-gitlab-monitoring-promethe-prometheus-db-prometheus-gitlab-monitoring-promethe-prometheus-1   Failed to provision volume with StorageClass "standard-regional-east1": kubernetes does not have nodes in specified zones: map["us-east1-c":{}]. Zones that contain nodes: map["us-east1-b":{}]

It looks like the problem is related to the storage class of the disk