Pipeline breaks when running 3.1
Backstory: Last week we updated the docker image to run Ruby 3.1 with !144 (merged). Gitlab is not quite compatible with 3.1, due to the error seen below. We should use an image that features 3.0.
https://ops.gitlab.net/gitlab-com/database-team/gitlab-com-database-testing/-/jobs/9927474