Conflate remote rpcs to a configurable timeout
When buildbox-casd
is running in proxy mode, it will faithfully and correctly replicate many of the requests it receives to the remote. This is to ensure absolute consistency between the local and remote: for example, a blob may be available remotely but has been evicted remotely.
In the interests of performance and based on real-life experiences, it's probably OK to relax this slightly. Something along the lines of "only replicate requests at most once every N seconds for each blob". The aim is to provide time and work savings for blobs that are frequently accessed (such as those core blobs in the input root).