Move test cache config into testhelpers

What does this MR do?

This reduces some code duplication.

Closes #799 (closed)

TODO

• I added the Changelog trailer (e.g. Changelog: added) to the commits that need to be included in the changelog
• I added unit tests or they are not required
• I added acceptance tests or they are not required
• I added documentation (or it's not required)
• I followed code review guidelines
• I followed Go Style guidelines