cinder-csi: need to reload 'cinder-csi-cloud-config' Secret when CAPO `cluster.capo.clouds_yaml` changes

When the password of the openstack tenant is changed by IaaS administrator, the related Sylva 'secrets.yaml' file can be easily updated and the ./apply-workload-cluster.sh <path> command executed. The internal 'sylva-units-secrets' secret in the Workload Cluster' namespace in MNGT cluster is properly updated... and the cinder related secret is also updated properly.

But the "openstack-cinder-csi-controllerplugin-XX-YY" pod inside the WC's 'cinder-csi' namespace is not reloaded with the new secret leading to new cinder-CIS-based PVC which remain 'Pending' Until the controllerplugin pod is deleted , no new PVC can be allocated.

  • check global secret via k get secret -n wc-<ericsson-rim>MY-WC> sylva-units-secrets --show-managed-fields -o yaml command to verify it was recently updated
  • check new cinder-csi secret via kubectl get -n cinder-csi secret cinder-csi-cloud-config -oyaml --kubeconfig <~/my-deployment/sylva-core/wc-KC/comarch-rim-kc.yaml>WC-KC.yaml | yq '.data."cloud.conf"' | base6
  • delete the controler pod as a workaround

Until the controllerplugin pod is deleted , the 'test-cinder' client pods remain 'Pending' as clained PVC is 'Pending' even if the 'cinder-csi-nodeplugin' were deleted & re-created

ubuntu@rfp-test-bootstrap:~/my-deployment/sylva-core$ k delete  pod -n cinder-csi --kubeconfig ~/my-deployment/sylva-core/wc-KC/comarch-rim-kc.yaml openstack-cinder-csi-controllerplugin-76444c4c85-kg8cb
pod "openstack-cinder-csi-controllerplugin-76444c4c85-kg8cb" deleted
ubuntu@rfp-test-bootstrap:~/my-deployment/sylva-core$  k get pod -A --kubeconfig ~/my-deployment/sylva-core/wc-KC/comarch-rim-kc.yaml |grep cinder
cinder-csi                 openstack-cinder-csi-controllerplugin-76444c4c85-7nv5m     0/6     ContainerCreating   0              7s
cinder-csi                 openstack-cinder-csi-nodeplugin-clxq7                      3/3     Running             0              44s
cinder-csi                 openstack-cinder-csi-nodeplugin-ltnrm                      3/3     Running             0              36s
cinder-csi                 openstack-cinder-csi-nodeplugin-vm4rr                      3/3     Running             0              51s
cinder-csi                 openstack-cinder-csi-nodeplugin-xbc9l                      3/3     Running             0              59s
test-cinder                mpod-persist-deployment-6994c887db-5wj6m                   0/1     Pending             0              7m4s
test-cinder                mpod-persist-deployment-6994c887db-ffwwd                   0/1     Pending             0              7m4s
test-cinder                mpod-persist-deployment-6994c887db-w9pwq                   0/1     Pending             0              7m4s
ubuntu@rfp-test-bootstrap:~/my-deployment/sylva-core$ k get pod -A --kubeconfig ~/my-deployment/sylva-core/wc-KC/comarch-rim-kc.yaml |grep cinder
cinder-csi                 openstack-cinder-csi-controllerplugin-76444c4c85-7nv5m     6/6     Running             0              43s
cinder-csi                 openstack-cinder-csi-nodeplugin-clxq7                      3/3     Running             0              80s
cinder-csi                 openstack-cinder-csi-nodeplugin-ltnrm                      3/3     Running             0              72s
cinder-csi                 openstack-cinder-csi-nodeplugin-vm4rr                      3/3     Running             0              87s
cinder-csi                 openstack-cinder-csi-nodeplugin-xbc9l                      3/3     Running             0              95s
test-cinder                mpod-persist-deployment-6994c887db-5wj6m                   0/1     ContainerCreating   0              7m40s
test-cinder                mpod-persist-deployment-6994c887db-ffwwd                   0/1     ContainerCreating   0              7m40s
test-cinder                mpod-persist-deployment-6994c887db-w9pwq                   0/1     ContainerCreating   0              7m40s
ubuntu@rfp-test-bootstrap:~/my-deployment/sylva-core$
 °°°
test-cinder                mpod-persist-deployment-6994c887db-5wj6m                   1/1     Running             0              8m45s
Edited Dec 06, 2024 by Thomas Morin
Assignee Loading
Time tracking Loading