Convert kyverno tests jobs in pytest (!8852) · Merge requests · Sylva-projects / sylva-core

What does this MR do and why?

Convert our existing kyverno test into pytest.

When a failure is detected, it will create a failed subtest to have a cleaner output than a giant failure

eg:

SUBFAILED(resource='default/fake-failing-report') tests/security/test_kyverno.py::test_policy_reports - Failed: PolicyReport 'default/fake-failing-report' — fail=1 warn=0 error=0; see output/kyverno/policy_reports/default_fake-failing-report.json                                                                                                                          
SUBFAILED(resource='default/fake-failing-report-1') tests/security/test_kyverno.py::test_policy_reports - Failed: PolicyReport 'default/fake-failing-report-1' — fail=1 warn=0 error=0; 
see output/kyverno/policy_reports/default_fake-failing-report-1.json                                                                                                                    
SUBFAILED(resource='default/fake-failing-report-10') tests/security/test_kyverno.py::test_policy_reports - Failed: PolicyReport 'default/fake-failing-report-10' — fail=10 warn=0 error=
0; see output/kyverno/policy_reports/default_fake-failing-report-10.json

I haven't mark it as "management" cluster only, so we can check at each step of the deployment that we don't have report failure. The test are using mgmt_cluster fixture to always talk to the management.

Test coverage

CI configuration

Below you can choose test deployment variants to run in this MR's CI.

Click to open to CI configuration

Legend:

Icon	Meaning	Available values
☁️	Infra Provider	`capd`, `capo`, `capm3`
🚀	Bootstrap Provider	`kubeadm` (alias `kadm`), `rke2`, `okd`, `ck8s`
🐧	Node OS	`ubuntu`, `suse`, `na`, `leapmicro`
🛠️	Deployment Options	Deployment option list and description
🎬	Pipeline Scenarios	Available scenario list and description
🟢	Enabled units	Any available units name, by default apply to management and workload cluster. Can be prefixed by `mgmt:` or `wkld:` to be applied only to a specific cluster type
🔴	Disabled units	Any available units name, by default apply to management and workload cluster. Can be prefixed by `mgmt:` or `wkld:` to be applied only to a specific cluster type
🏗️	Target platform	Can be used to select specific deployment environment Available platform list and description
⚡	Pipeline control	`autorun`, `manual` or `blocking`. Can be used to override global config and start a deployment pipeline the required way

Global config for deployment pipelines

autorun pipelines
allow failure on pipelines
record sylvactl events

Notes:

Enabling autorun will make deployment pipelines to be run automatically without human interaction
Disabling allow failure will make deployment pipelines mandatory for pipeline success.
if both autorun and allow failure are disabled, deployment pipelines will need manual triggering but will be blocking the pipeline

Be aware: after configuration change, pipeline is not triggered automatically. Please run it manually (by clicking the run pipeline button in Pipelines tab) or push new code.

Edited Aug 26, 2026 by Loic Nicolle

Convert kyverno tests jobs in pytest

What does this MR do and why?

Related reference(s)

Test coverage

CI configuration

Global config for deployment pipelines

Merge request reports