Improve caching of responses in bgd browser-backend
Before raising this MR, consider whether the following are required, and complete if so:
-
Unit tests -
Metrics -
Documentation update(s)
If not required, please explain in brief why not.
Description
This MR improves the ActionResult cache which already exists to use an async-safe LRU implementation, rather than a blocking implementation. It also adds caches for blobs and Operations, which further reduce the number of requests that need to actually be sent to BuildGrid.
In draft because various pieces are untested at the moment.
Edited by Adam Coldrick