Reduce risk of 502 errors in huge namespaces

What does this MR do?

Naive implementation of gitlab#577651

TODO

• Feature flag
  • Added feature flag:
  • This feature does not require a feature flag
• I added the Changelog trailer to the commits that need to be included in the changelog (e.g. Changelog: added)
• I added unit tests or they are not required
  • tests updated
• I added acceptance tests or they are not required
• I added documentation (or it's not required)
• I followed code review guidelines
• I followed Go Style guidelines