Modify cluster_domain failed without explicit error and pods restart

Sylva 1.3.7. Capo.

Test: set cluster_domain:vdr2.clm.bis.sylva

The cluster_domain name modification is requested in case of capo migration/modification.

On the MC and WC : all pods are running.

No error on sylvactl watch

 ✓ Kustomization/sylva-system/loki - Resource is ready: Loki can be reached at https://loki.vdr2.clm.bis.sylva (loki.vdr2.clm.bis.sylva must resolve to 172.20.132.244)
 ✓ Kustomization/sylva-system/monitoring - Resource is ready: Grafana UI can be reached at https://grafana.vdr2.clm.bis.sylva (grafana.vdr2.clm.bis.sylva must resolve to 172.20.132.244)
 ✓ Kustomization/sylva-system/prometheus-pushgateway - Resource is ready
 ✓ Kustomization/sylva-system/rancher-keycloak-oidc-provider - Resource is ready
 ✓ Kustomization/sylva-system/sylva-dashboards - Resource is ready
 ✓ Kustomization/sylva-system/sylva-prometheus-rules - Resource is ready
 ✓ Kustomization/sylva-system/cluster-creator-login - Resource is ready
 ✓ Kustomization/sylva-system/cluster-creator-policy - Resource is ready
 ✓ Kustomization/sylva-system/flux-webui - Resource is ready: Flux Web UI can be reached at https://flux.vdr2.clm.bis.sylva (flux.vdr2.clm.bis.sylva must resolve to 172.20.132.244)
 ✓ Kustomization/sylva-system/harbor-init - Resource is ready
 ✓ Kustomization/sylva-system/harbor-postgres - Resource is ready
 ✓ Kustomization/sylva-system/logging - Resource is ready
 ✓ Kustomization/sylva-system/logging-config - Resource is ready
 ✓ Kustomization/sylva-system/harbor - Resource is ready: Harbor UI can be reached at https://harbor.vdr2.clm.bis.sylva (harbor.vdr2.clm.bis.sylva must resolve to 172.20.132.244)
 ✓ Kustomization/sylva-system/sylva-units-status - Resource is ready
 ✓ All Done!

PASS Access to: rancher.vdr2.clm.bis.sylva flux.vdr2.clm.bis.sylva thanos.vdr2.clm.bis.sylva minio-operator-console.vdr2.clm.bis.sylva minio-monitoring-console.vdr2.clm.bis.sylva minio-logging-console.vdr2.clm.bis.sylva keycloak.vdr2.clm.bis.sylva vault.vdr2.clm.bis.sylva neuvectore.vdr2.clm.bis.sylva  

FAIL Access to: grafana.vdr2.clm.bis.sylva harbor.vdr2.clm.bis.sylva

Grafana is accessible via Rancher but not via https://grafana.vdr2.clm.bis.sylva|https://grafana.vdr2.clm.bis.sylva/

Several MC pods restart and vault-config-operator in CrashLoopBackOff.

ubuntu@bootstrap:~/my-deployment/sylva-core$ k get pods -A | grep '('
calico-system               calico-node-bv5hr                                                 1/1     Running                  1 (177m ago)     3h
capi-system                 capi-controller-manager-6bddcb7c6b-thgjh                          1/1     Running                  16 (5m24s ago)   3h7m
capi-system                 capi-controller-manager-6bddcb7c6b-vrq8b                          1/1     Running                  17 (10m ago)     3h24m
capo-system                 capo-controller-manager-6896859544-ln44j                          1/1     Running                  12 (40m ago)     3h7m
capo-system                 capo-controller-manager-6896859544-x7mcl                          1/1     Running                  9 (18s ago)      177m
cattle-fleet-system         fleet-controller-66fd75ff-sq2c5                                   3/3     Running                  2 (101m ago)     160m
cattle-fleet-system         gitjob-9f4b75d8b-67tlr                                            1/1     Running                  2 (101m ago)     160m
cattle-logging-system       logging-rancher-logging-764b874fdd-jhsk2                          1/1     Running                  21 (5m25s ago)   3h24m
cattle-monitoring-system    prometheus-rancher-monitoring-prometheus-0                        3/3     Running                  7 (9m24s ago)    176m
cattle-monitoring-system    rancher-monitoring-prometheus-adapter-7ccfcd4456-hp95g            1/1     Running                  2 (96m ago)      3h24m
cattle-monitoring-system    rancher-monitoring-prometheus-node-exporter-fczxb                 1/1     Running                  3 (93m ago)      3h26m
cattle-monitoring-system    rancher-monitoring-prometheus-node-exporter-tqvcj                 1/1     Running                  2 (154m ago)     3h8m
cattle-system               rancher-85bc95dd54-vzjgd                                          1/1     Running                  22 (73m ago)     167m
cattle-system               rancher-85bc95dd54-wrc6s                                          1/1     Running                  3 (162m ago)     166m
cattle-system               rancher-webhook-7cff54b57d-jdkq8                                  1/1     Running                  4 (82m ago)      3h7m
cert-manager                cert-manager-5cb7ccb8f9-r92sd                                     1/1     Running                  1 (101m ago)     3h7m
cert-manager                cert-manager-cainjector-6687b5db79-nrbt5                          1/1     Running                  2 (93m ago)      3h7m
cert-manager                cert-manager-cainjector-6687b5db79-xdw2w                          1/1     Running                  1 (101m ago)     3h24m
cinder-csi                  openstack-cinder-csi-controllerplugin-69bd8975d8-585pb            5/6     CrashLoopBackOff         90 (25s ago)     3h7m
cinder-csi                  openstack-cinder-csi-nodeplugin-8vdsx                             3/3     Running                  4 (3h24m ago)    3h26m
cinder-csi                  openstack-cinder-csi-nodeplugin-bt2td                             3/3     Running                  5 (3h6m ago)     3h8m
cinder-csi                  openstack-cinder-csi-nodeplugin-gjn7c                             3/3     Running                  12 (177m ago)    3h
cnpg-system                 cnpg-operator-cloudnative-pg-c9c9ff465-95bhq                      1/1     Running                  19 (25m ago)     3h7m
flux-system                 flux-webui-weave-gitops-6bf6db5dd6-v5kgm                          1/1     Running                  15 (89m ago)     3h24m
flux-system                 helm-controller-74df9d4cd4-65jn2                                  1/1     Running                  5 (92m ago)      3h24m
flux-system                 kustomize-controller-7f585fcb59-jmq8q                             1/1     Running                  3 (92m ago)      3h24m
flux-system                 notification-controller-848cb7b75b-2b8j9                          1/1     Running                  4 (93m ago)      3h24m
flux-system                 source-controller-7c5fbd97d6-d6hqp                                1/1     Running                  3 (92m ago)      3h24m
harbor                      harbor-core-76f78f8b48-57pbt                                      1/1     Running                  6 (12m ago)      157m
harbor                      harbor-jobservice-7d4f9c4f55-nhkvj                                1/1     Running                  4 (153m ago)     156m
harbor                      harbor-portal-64b7f64db6-sm4qm                                    1/1     Running                  1 (96m ago)      3h24m
heat-operator-system        heat-operator-controller-manager-5894f58f54-jlmqc                 2/2     Running                  25 (5m25s ago)   3h7m
keycloak                    cnpg-keycloak-2                                                   1/1     Running                  2 (92m ago)      3h21m
keycloak                    keycloak-1                                                        1/1     Running                  2 (80m ago)      167m
keycloak                    keycloak-2                                                        1/1     Running                  10 (82m ago)     167m
kube-system                 cloud-controller-manager-management-cluster-cp-1c016c888e-44mwc   0/1     Running                  10 (25s ago)     3h25m
kube-system                 cloud-controller-manager-management-cluster-cp-1c016c888e-4mr64   1/1     Running                  9 (10m ago)      3h
kube-system                 cloud-controller-manager-management-cluster-cp-1c016c888e-6vcvx   1/1     Running                  3 (65m ago)      3h8m
kube-system                 kube-apiserver-management-cluster-cp-1c016c888e-6vcvx             1/1     Running                  5 (13m ago)      3h8m
kube-system                 kube-controller-manager-management-cluster-cp-1c016c888e-44mwc    1/1     Running                  8 (24s ago)      3h25m
kube-system                 kube-controller-manager-management-cluster-cp-1c016c888e-4mr64    1/1     Running                  11 (10m ago)     3h
kube-system                 kube-controller-manager-management-cluster-cp-1c016c888e-6vcvx    1/1     Running                  3 (65m ago)      3h8m
kube-system                 kube-scheduler-management-cluster-cp-1c016c888e-44mwc             1/1     Running                  8 (5m20s ago)    3h24m
kube-system                 kube-scheduler-management-cluster-cp-1c016c888e-4mr64             1/1     Running                  10 (10m ago)     3h
kube-system                 kube-scheduler-management-cluster-cp-1c016c888e-6vcvx             1/1     Running                  4 (40m ago)      3h8m
kube-system                 rke2-coredns-rke2-coredns-b5cddd8b9-wzq54                         1/1     Running                  2 (95m ago)      3h24m
kube-system                 rke2-ingress-nginx-controller-7hch2                               1/1     Running                  1 (95m ago)      3h24m
kube-system                 rke2-metrics-server-6b956496d6-kvfp2                              1/1     Running                  4 (93m ago)      3h24m
kube-system                 rke2-snapshot-controller-84b6dfd89c-lqxp4                         1/1     Running                  21 (5m23s ago)   3h24m
kyverno                     kyverno-admission-controller-795dd96456-9xffr                     1/1     Running                  8 (10m ago)      3h24m
kyverno                     kyverno-admission-controller-795dd96456-tntr6                     1/1     Running                  2 (155m ago)     3h7m
kyverno                     kyverno-admission-controller-795dd96456-z6fl9                     1/1     Running                  8 (15m ago)      176m
kyverno                     kyverno-background-controller-7b59dbbc97-6gxk6                    1/1     Running                  7 (45m ago)      3h24m
kyverno                     kyverno-background-controller-7b59dbbc97-jlgmp                    1/1     Running                  2 (20m ago)      3h7m
kyverno                     kyverno-background-controller-7b59dbbc97-qdh8m                    1/1     Running                  4 (35m ago)      176m
kyverno                     kyverno-cleanup-controller-cd4ccdd8c-mbl99                        1/1     Running                  9 (10m ago)      3h24m
kyverno                     kyverno-cleanup-controller-cd4ccdd8c-nbs4t                        1/1     Running                  7 (13m ago)      3h7m
kyverno                     kyverno-cleanup-controller-cd4ccdd8c-trmpm                        1/1     Running                  4 (35m ago)      176m
kyverno                     kyverno-reports-controller-585bdb5867-4xcdw                       1/1     Running                  5 (20m ago)      176m
kyverno                     kyverno-reports-controller-585bdb5867-6xf82                       1/1     Running                  6 (85m ago)      3h24m
kyverno                     kyverno-reports-controller-585bdb5867-9mnwp                       1/1     Running                  3 (79m ago)      3h7m
metallb-system              metallb-speaker-r5rnz                                             1/1     Running                  9 (79m ago)      3h7m
metallb-system              metallb-speaker-tf5v8                                             1/1     Running                  4 (93m ago)      3h24m
rke2-bootstrap-system       rke2-bootstrap-controller-manager-698bfdd8d5-s7x69                1/1     Running                  19 (25s ago)     3h7m
rke2-bootstrap-system       rke2-bootstrap-controller-manager-698bfdd8d5-wbl7k                1/1     Running                  17 (5m25s ago)   3h24m
rke2-control-plane-system   rke2-control-plane-controller-manager-69cc454666-4cqbp            1/1     Running                  15 (10m ago)     3h7m
rke2-control-plane-system   rke2-control-plane-controller-manager-69cc454666-hj9k4            1/1     Running                  17 (5m24s ago)   3h24m
thanos                      thanos-receive-0                                                  1/1     Running                  1 (89m ago)      3h24m
thanos                      thanos-storegateway-0                                             1/1     Running                  3 (174m ago)     176m
tigera-operator             tigera-operator-79b6866c88-59mfr                                  1/1     Running                  23 (5m25s ago)   3h24m
vault                       vault-0                                                           2/2     Running                  4 (93m ago)      3h22m
vault                       vault-2                                                           2/2     Running                  2 (154m ago)     3h7m
vault                       vault-config-operator-78c5555cbf-q5xq6                            0/1     ContainerStatusUnknown   17 (98m ago)     3h24m
vault                       vault-config-operator-78c5555cbf-t6scj                            0/1     CrashLoopBackOff         9 (24s ago)      94m
vault                       vault-operator-666f8bcd49-zssn4                                   1/1     Running                  12 (5m21s ago)   3h7m
Edited Mar 21, 2025 by Claudine Le Mercier
Assignee Loading
Time tracking Loading