Fix cache tests
Fix CI failures caused by PR !98 (closed).
This requires fixing the --config-file option so it can be reliably used from the caching tests, and using it in the caching tests so the config file missing warning does not cause the caching tests to fail.