This was quick to do... A bit harder to test!
Fixes https://gitlab.com/gitlab-org/release-tools/issues/54