Trying to mitigate a mtime granularity braking the cache tests

This patch mitigates the granularity of the mtimes used on the default
gitlab runners, Allowing the test suite to pass on these runners.