WIP: jennis/136 clean remote cache

James Ennisrequested to merge
jennis/136-clean-remote-cache into master

Important Note

This MR has been superseded by !477 (closed)

Description

Fixes #136 (closed)

Currently, the remote artifact cache is unbound and BuildStream will keep pushing artifacts to the cache regardless of its physical size.

This patch aims to allow the remote cache to be configured with a quota, which, when exceeded, the Least Recently Pushed artifacts will be expired in order to make space for artifacts being pushed.

  • Determine the size of the remote cache
  • Remove LRP artifacts until there is enough room
  • Determine the size of the artifact being sent
  • Allow the user to configure a cache quota for their remote cache
  • Allow for human-friendly cache quotas (e.g. 20G)
  • Ensure that a large artifact won't be pushed
Edited by James Ennis

Merge request reports