Proposal: Test gitlab-runner rpm/deb packages

The runner release process creates rpm and deb packages of gitlab-runner (and exported helper images) for various linux distributions and architectures. However, these packages are currently not tested in any way, and we've recently made changes that broke these packages in various ways.

We should test the produced images for at least the following functionality:

  • Installation ("latest" and specific versions)
  • Upgrades
  • Downgrades
  • Inspect systemd unit files/init scripts

It'd be nice to test packages for all distro/distro versions/architectures we support, but that's probably overkill. Some sampling of rpm and deb distros and arches will probably be enough.

A VERY WIP implementation is in progress https://gitlab.com/avonbertoldi/gitlab-runner-package-tests

Edited by Axel von Bertoldi