-
- Downloads
Don't pull artifact build trees by default.
The addition of cached build trees being included in element artifacts has led to mostly redundant download overheads when pulling from a remote artifact server. As such the default behaviour of pull shouldn't fetch the build tree object if available. pullqueue.py: add extensible attributes to determine required/ excluded directories for element pull jobs. scheduler context is used to determine pull_buildtrees context. element.py: extend relevant pull logic for specified subdir consideration and ensure push logic does not lead to partial artifact pushes. Change assumption that the buildtree can be extracted if artifact is cached. _artifactcache/: artifactcache.py & cascache.py inclusion of helper functions for subdir artifact checking & fetching, fetch logic extended to only pull required artifact directories. extract & checkout updated to handle full/partial operation. tests/: addition of integration test pullbuildtrees.py, buildtrees.py adapted cli options, testutils/artifactshare.py has_artifact changed to return artifact digest on true condition.
Showing
- NEWS 12 additions, 2 deletionsNEWS
- buildstream/_artifactcache/artifactcache.py 28 additions, 4 deletionsbuildstream/_artifactcache/artifactcache.py
- buildstream/_artifactcache/cascache.py 61 additions, 12 deletionsbuildstream/_artifactcache/cascache.py
- buildstream/_scheduler/queues/pullqueue.py 14 additions, 2 deletionsbuildstream/_scheduler/queues/pullqueue.py
- buildstream/element.py 98 additions, 39 deletionsbuildstream/element.py
- tests/integration/build-tree.py 2 additions, 2 deletionstests/integration/build-tree.py
- tests/integration/pullbuildtrees.py 147 additions, 0 deletionstests/integration/pullbuildtrees.py
- tests/testutils/artifactshare.py 3 additions, 3 deletionstests/testutils/artifactshare.py
Loading
Please register or sign in to comment