Out of memory spec failures

9-1-stable-ee is failing due a combination of spec failures and memory issues:

https://gitlab.com/gitlab-org/gitlab-ee/builds/14337352/raw

We need to resolve this for RC2.

/cc: @rymai