richardmaw-codethink authored Nov 05, 2018 and richardmaw-codethink committed Nov 05, 2018

"_frontend/app.py: Set correct element-path in interactive bst-init"
added a dependency on the tmp_path test fixture, which was added by 3.8.

dev-requirements: Update pytest dependency to 3.8

See merge request !930

Get the artifact cache from the context instead.

The artifact cache backend does not affect build outputs and we anyway
no longer have pluggable artifact cache backends. This hardcodes
CASCache instead of removing the entry completely to avoid cache key
changes.

This changes CASCache from a subclass to a delegate object of
ArtifactCache. As the lower layer, CASCache no longer deals with
elements or projects.

Fixes #659.

Split up artifact cache and CAS cache

Closes #659

See merge request !922

of which is set to False via the addition of pullbuildtree to
userconfig.yaml

_frontend/app.py & cli.py: Add --pull-build-trees as a bst main
option, which when passed will override the default or user defined
context for pull_buildtrees

tests/completions/completions.py: Update for the added flag

The addition of cached build trees being included in element
artifacts has led to mostly redundant download overheads when
pulling from a remote artifact server. As such the default behaviour
of pull shouldn't fetch the build tree object if available.

pullqueue.py: add extensible attributes to determine required/
excluded directories for element pull jobs. scheduler context
is used to determine pull_build_trees context.

element.py: extend relevant pull logic for specified subdir
consideration and ensure push logic does not lead to partial
artifact pushes. Change assumption that buildtree can be
extracted if artifact is cached.

_artifactcache/: artifactcache.py & cascache.py inclusion of
helper functions for subdir artifact checking & fetching, fetch
logic extended to only pull required artifact directories.
extract & checkout updated to handle full/partial operation.

tests/: addition of integration test pullbuildtrees.py,
buildtrees.py adapted cli options, testutils/artifactshare.py
has_artifact changed to return artifact digest on true condition.