Add upgrade tests
I guess this is similar to #33 (closed) but still different as the scope is wider. I'm thinking we can specify in the versions.json file that we want to test upgrade from certain versions. This means tests that involve running NSO twice, like checking that SSH host key is persisted, can first be run with OLD_VERSION and then with NEW_VERSION. This way we can easily see and detect behaviour across versions and how it affects users.
-
make test scaffolding multi-version compatible !68 (merged) -
use predictable docker tags !70 (merged) -
incorporate multi-version testing in CI -
rename upgrade-test to multi-version-test !71 (merged) -
change docker tag by reversing pipeline id and nso version, 5.3-123412 makes more sense than 123412-5.3 !72 (merged) -
generate multi-version test jobs from version-includes/versions.json !78 (merged)
Edited by Kristian Larsson