deps-project-tool.py: add --check-unconsumed-tags option

Thomas Morinrequested to merge
deps-project-tool.py---check-unconsumed-tags into main

This is a small evolution to the deps-project-tool.py: the new --check-unconsumed-tags option allows to list sylva-elements repos that would have x.y.(z+n) tags that sylva-core would not yet consume.

Example output:

$ tools/deps-project-tool.py --check-unconsumed-tags
processing 27 projects...
sylva-projects/sylva-elements/container-images/ci-image ...
  used: v1.5.0
  checking v1.5.* tags
sylva-projects/sylva-elements/container-images/kube-job ...
  used: v1.4.2
  checking v1.4.* tags
sylva-projects/sylva-elements/container-images/libvirt-metal ...
  used: 0.3.2
  checking 0.3.* tags
sylva-projects/sylva-elements/container-images/oci-tools ...
  used: 0.3.2
  checking 0.3.* tags
sylva-projects/sylva-elements/container-images/rke2-in-docker ...
  used: 0.4.1-v1.33.5rke2r1
  checking 0.4.1-v1.33.5rke2r1 tags
sylva-projects/sylva-elements/container-images/sylva-toolbox ...
  used: v1.3.1
  checking v1.3.* tags
sylva-projects/sylva-elements/diskimage-builder ...
  used: 0.7.4
  checking 0.7.* tags
  ⚠️ tag 0.7.5 is not consumed
  ⚠️ tag 0.7.6 is not consumed
sylva-projects/sylva-elements/heat-operator ...
  used: 0.3.1
  checking 0.3.* tags
sylva-projects/sylva-elements/helm-charts/capo-contrail-bgpaas ...
  used: 1.3.5
  checking 1.3.* tags
sylva-projects/sylva-elements/helm-charts/keycloak-user-management ...
  used: 0.1.0
  checking 0.1.* tags
sylva-projects/sylva-elements/helm-charts/os-image-server ...
  used: 2.6.2
  checking 2.6.* tags
sylva-projects/sylva-elements/helm-charts/rancher-roles-management ...
  used: 0.1.0
  checking 0.1.* tags
sylva-projects/sylva-elements/helm-charts/sylva-alertmanager-resources ...
  used: 0.2.0
  checking 0.2.* tags
sylva-projects/sylva-elements/helm-charts/sylva-capi-cluster ...
  used: 0.12.25
  checking 0.12.* tags
sylva-projects/sylva-elements/helm-charts/sylva-dashboards ...
  used: 0.2.3
  checking 0.2.* tags
sylva-projects/sylva-elements/helm-charts/sylva-library ...
  used: 0.7.3
  checking 0.7.* tags
sylva-projects/sylva-elements/helm-charts/sylva-logging-flows ...
  used: 0.2.0
  checking 0.2.* tags
sylva-projects/sylva-elements/helm-charts/sylva-prometheus-rules ...
  used: 0.2.4
  checking 0.2.* tags
sylva-projects/sylva-elements/helm-charts/sylva-snmp-resources ...
  used: 0.2.0
  checking 0.2.* tags
sylva-projects/sylva-elements/helm-charts/sylva-thanos-rules ...
  used: 0.3.1
  checking 0.3.* tags
sylva-projects/sylva-elements/helm-charts/sync-openstack-images ...
  used: 0.7.2
  checking 0.7.* tags
sylva-projects/sylva-elements/helm-charts/workload-team-defs ...
  used: 0.5.1
  checking 0.5.* tags
sylva-projects/sylva-elements/kiwi-imagebuilder ...
  used: 0.3.3
  checking 0.3.* tags
sylva-projects/sylva-elements/misc-controllers-suite ...
  used: v1.2.1
  checking v1.2.* tags
sylva-projects/sylva-elements/sylva-units-operator ...
  used: v1.1.2
  checking v1.1.* tags
  ⚠️ tag v1.1.3 is not consumed
  ⚠️ tag v1.1.4 is not consumed
sylva-projects/sylva-elements/sylvactl ...
  used: v0.11.0
  checking v0.11.* tags
sylva-projects/sylva-elements/workload-cluster-operator ...
  used: v0.12.0
  checking v0.12.* tags

CI configuration

Below you can choose test deployment variants to run in this MR's CI.

Click to open to CI configuration

Legend:

Icon Meaning Available values
☁️ Infra Provider capd, capo, capm3
🚀 Bootstrap Provider kubeadm (alias kadm), rke2, okd, ck8s
🐧 Node OS ubuntu, suse, na, leapmicro
🛠️ Deployment Options light-deploy, dev-sources, ha, misc, maxsurge-0, logging, no-logging, cilium
🎬 Pipeline Scenarios Available scenario list and description
🟢 Enabled units Any available units name, by default apply to management and workload cluster. Can be prefixed by mgmt: or wkld: to be applied only to a specific cluster type
🏗️ Target platform Can be used to select specific deployment environment (i.e real-bmh for capm3 )

  • 🎬 preview ☁️ capd 🚀 kadm 🐧 ubuntu

  • 🎬 preview ☁️ capo 🚀 rke2 🐧 suse

  • 🎬 preview ☁️ capm3 🚀 rke2 🐧 ubuntu

  • ☁️ capd 🚀 kadm 🛠️ light-deploy 🐧 ubuntu

  • ☁️ capd 🚀 rke2 🛠️ light-deploy 🐧 suse

  • ☁️ capo 🚀 rke2 🐧 suse

  • ☁️ capo 🚀 rke2 🐧 leapmicro

  • ☁️ capo 🚀 kadm 🐧 ubuntu

  • ☁️ capo 🚀 kadm 🐧 ubuntu 🟢 neuvector,mgmt:harbor

  • ☁️ capo 🚀 rke2 🎬 rolling-update 🛠️ ha 🐧 ubuntu

  • ☁️ capo 🚀 kadm 🎬 wkld-k8s-upgrade 🐧 ubuntu

  • ☁️ capo 🚀 rke2 🎬 rolling-update-no-wkld 🛠️ ha 🐧 suse

  • ☁️ capo 🚀 rke2 🎬 sylva-upgrade-from-1.5.x 🛠️ ha 🐧 ubuntu

  • ☁️ capo 🚀 rke2 🎬 sylva-upgrade-from-1.5.x 🛠️ ha,misc 🐧 ubuntu

  • ☁️ capo 🚀 rke2 🛠️ ha,misc 🐧 ubuntu

  • ☁️ capo 🚀 rke2 🛠️ ha,misc,openbao🐧 suse

  • ☁️ capo 🚀 rke2 🐧 suse 🎬 upgrade-from-prev-tag

  • ☁️ capm3 🚀 rke2 🐧 suse

  • ☁️ capm3 🚀 kadm 🐧 ubuntu

  • ☁️ capm3 🚀 ck8s 🐧 ubuntu

  • ☁️ capm3 🚀 kadm 🎬 rolling-update-no-wkld 🛠️ ha,misc 🐧 ubuntu

  • ☁️ capm3 🚀 rke2 🎬 wkld-k8s-upgrade 🛠️ ha 🐧 suse

  • ☁️ capm3 🚀 kadm 🎬 rolling-update 🛠️ ha 🐧 ubuntu

  • ☁️ capm3 🚀 rke2 🎬 sylva-upgrade-from-1.5.x 🛠️ ha 🐧 suse

  • ☁️ capm3 🚀 rke2 🛠️ misc,ha 🐧 suse

  • ☁️ capm3 🚀 rke2 🎬 sylva-upgrade-from-1.5.x 🛠️ ha,misc 🐧 suse

  • ☁️ capm3 🚀 kadm 🎬 rolling-update 🛠️ ha 🐧 suse

  • ☁️ capm3 🚀 ck8s 🎬 rolling-update 🛠️ ha 🐧 ubuntu

  • ☁️ capm3 🚀 rke2|okd 🎬 no-update 🐧 ubuntu|na

  • ☁️ capm3 🚀 rke2 🐧 suse 🎬 upgrade-from-release-1.5

  • ☁️ capm3 🚀 rke2 🐧 suse 🎬 upgrade-to-main

Global config for deployment pipelines

  • autorun pipelines
  • allow failure on pipelines
  • record sylvactl events

Notes:

  • Enabling autorun will make deployment pipelines to be run automatically without human interaction
  • Disabling allow failure will make deployment pipelines mandatory for pipeline success.
  • if both autorun and allow failure are disabled, deployment pipelines will need manual triggering but will be blocking the pipeline

Be aware: after configuration change, pipeline is not triggered automatically. Please run it manually (by clicking the run pipeline button in Pipelines tab) or push new code.

Edited by Thomas Morin

Merge request reports