New hset_redis_diff_cache hits Redis more than necessary
I've noticed it in a big MR:
We should be memoizing a few things to avoid that.