[backport-1.4]: add a test to ensure that we don't downgrade versions between branches

Issue #2720 (closed) needs to be backported to 1.4.x