capo-rke2-oci-ubuntu mgmt cluster deployment failed due to immutable cluster config
Issue is seen in capo-rke2-oci-ubuntu pipeline https://gitlab.com/sylva-projects/sylva-core/-/jobs/7167144991 where management cluster fails to reconcile because of immutable parameters in cluster config.
2024-06-24T00:35:53Z 2024-06-24T00:35:53Z HelmRelease sylva-system cluster 1 InstallFailed "Helm install failed for release sylva-system/cluster with chart sylva-capi-cluster@0.2.23: 1 error occurred:
* Internal error occurred: error resolving resource
Last Helm logs:
2024-06-24T00:35:52.636933Z: creating 1 resource(s)
2024-06-24T00:35:52.756880087Z: creating 11 resource(s)"
2024-06-24T00:35:53Z 2024-06-24T00:35:53Z MachineSet sylva-system mgmt-1344603520-rke2-capo-oci-md0-vwj24 1 ReconcileError failed to sync MachineSet replicas: failed to clone infrastructure machine from OpenStackMachineTemplate mgmt-1344603520-rke2-capo-oci-md-md0-f7cd2a9e8a while creating a machine: Internal error occurred: error resolving resource
2024-06-24T00:35:53Z 2024-06-24T00:35:53Z MachineSet sylva-system mgmt-1344603520-rke2-capo-oci-md0-vwj24 1 SuccessfulCreate "Created machine ""mgmt-1344603520-rke2-capo-oci-md0-vwj24-8dbk9"""
2024-06-24T00:35:53Z 2024-06-24T00:35:53Z MachineDeployment sylva-system mgmt-1344603520-rke2-capo-oci-md0 2 ReconcileError "rke2configtemplates.bootstrap.cluster.x-k8s.io ""mgmt-1344603520-rke2-capo-oci-md0-43e15b2571"" is forbidden: User ""system:serviceaccount:capi-system:capi-manager"" cannot patch resource ""rke2configtemplates"" in API group ""bootstrap.cluster.x-k8s.io"" in the namespace ""sylva-system"""
2024-06-24T00:35:53Z 2024-06-24T00:35:53Z MachineDeployment sylva-system mgmt-1344603520-rke2-capo-oci-md0 1 SuccessfulCreate Created MachineSet sylva-system/mgmt-1344603520-rke2-capo-oci-md0-vwj24
2024-06-24T00:35:54Z 2024-06-24T00:35:54Z Pod sylva-system cluster-pre-delete-hook-q9ljd 1 Scheduled Successfully assigned sylva-system/cluster-pre-delete-hook-q9ljd to bootstrap-1344603520-rke2-capo-oci-control-plane
2024-06-24T00:35:54Z 2024-06-24T00:35:54Z Pod sylva-system cluster-pre-delete-hook-q9ljd 1 Pulling "Pulling image ""registry.gitlab.com/sylva-projects/sylva-elements/container-images/kube-job:v1.0.5"""
2024-06-24T00:35:54Z 2024-06-24T00:35:54Z Job sylva-system cluster-pre-delete-hook 1 SuccessfulCreate Created pod: cluster-pre-delete-hook-q9ljd
2024-06-24T00:44:56Z 2024-06-24T00:44:56Z HelmRelease sylva-system sylva-units 1 UpgradeFailed "Helm upgrade failed for release sylva-system/sylva-units with chart sylva-units@0.0.0-git-e7e891b6+1: execution error at (sylva-units/templates/sylva-units-values.yaml:83:77): Attempting to change value for '.cluster', which is immutable
Cluster values can't be changed, as they would trigger a rolling upgrade that is not supported in non-HA mode
Need to check why this immutability error is seen as this is fresh deployment of mgmt cluster
Edited by Priya Goyal