Add a more comprehensive test suite
Prior art:
-
cluster applications
: Integration tests using k3s (all builds) and GKE (only for release builds). Each testcase is a separate CI job. -
auto-deploy-app
: Lint and unit tests on the chart. No integration tests in the repo, but indirectly tested viaauto-deploy-image
-
auto-deploy-image
: k3s-only integration tests. Each testcase is a separate CI job - GitLab QA tests for the Configure stage: Tests in the GitLab QA test suite. Supports both k3s and GKE as cluster providers. Not sure which one is default in CI.
Proposal
- Merge the strategies of
auto-deploy-app
andauto-deploy-image
, i.e. do both template-level testing and integration tests - Consider using terratest for both levels of tests
- Use k3s as much as possible; external clusters (GKE, AKS etc) only if needed and only on
master