Skip to content

Split remote execution from artifact cache

Jim MacArthur requested to merge jmac/remote_execution_split into master

Description

Currently remote execution can only specify one URL, which is used for the REAPI server (usually BuildGrid), and remote storage has to be the same as the artifact cache. This MR splits those up, so you can specify another CAS remote, and separately specify the endpoint for the execution service.

You can still specify the same server for your artifact cache and remote execution store if you want.

At the moment, local RE CAS storage is still in the same location as artifact cache storage, it's just the remotes that differ.

Proposed changes

Changes proposed in this merge request:

  • Change config for remote execution so it can accept separate configuration for the execution server and storage service.
  • Create our own CASCache objects in SandboxRemote instead of using the artifact cache's objects.
  • Add documentation for the new config options
  • Add tests for new config options
  • Remove the methods in ArtifactCache which are only necessary for remote execution.

I'm not proposing to add a full CI remote execution test, but I will add some tests which check the new config option behaves sensibly.

This merge request, when approved, will close: #750 (closed)

Edited by Jim MacArthur

Merge request reports