capo-contrail-bgpaas failing to clear finalized on OpenStackMachines
This is a follow-up issue to #2941 which is a backport issue for https://gitlab.com/sylva-projects/sylva-core/-/issues/2736
The reason for creating it:
* the cause of #2941 is a failure by capo-contrail-bgpaas preventing the deletion of OpenStackMachines
* #2736 describes a *symptom* not a cause, and no logs have been preserved to know whether or not, so it's hard to know whether or not the cause is the same
* a tentative fix for this issue was worked on in https://gitlab.com/sylva-projects/sylva-elements/helm-charts/capo-contrail-bgpaas/-/issues/8, and the sylva-core integration MRs had been marked as "Closing" #2941, which is messy since #2941 is specific to release-1.5
The point of this issue is to have a clear issue for the capo-contrail-bgpaas problem.
### Status as of 2025-10-03
The tentative fix at https://gitlab.com/sylva-projects/sylva-elements/helm-charts/capo-contrail-bgpaas/-/issues/8 appears to not be sufficient, because the problem still occurs it's application to release-1.4 in https://gitlab.com/sylva-projects/sylva-core/-/merge_requests/5746 (see job https://gitlab.com/sylva-projects/sylva-core/-/jobs/11579019137 which has OpenStackMachines pending deletion blocked by the finalizer).
### Status as of 2025-10-20
While trying to troubleshoot and fix the problem, beyond the initial observations were the controller was failing to remove its finalizer on the OpenStackMachines, I also noticed potential cases where the OpenStackMachines was prevented because the HeatStack resources would either not have been removed or would have wrongly be recreated and would have prevented the deletion of the corresponding OpenStackMachine beucase of the presence of the blockOwnerDeletion ownerReference.
https://gitlab.com/sylva-projects/sylva-elements/helm-charts/capo-contrail-bgpaas/-/merge_requests/106 proposes controller improvements to avoid all those potential issues
### Status as of 2025-10-21
Even with the above improvement, the issue still reproduces: https://gitlab.com/sylva-projects/sylva-core/-/jobs/11781094274
:sob:
### Status as of 2026-04-13 :slight_smile:
I decided to try again to give a shot at solving https://gitlab.com/sylva-projects/sylva-core/-/work_items/2998, trying the newer Kopf versions since a lot of improvements fixes are mentioned in the release notes of the versions that appeared since the last version I had tried (1.37.3). Most recent kopf is now 1.44.
**This seems to give good results**
-> https://gitlab.com/sylva-projects/sylva-elements/helm-charts/capo-contrail-bgpaas/-/merge_requests/140
issue