Replacing string 'bzr' with value from host tools

See merge request !764

Explicitly check that project.conf contains a name. This resolves
the issue of the provenance check from _yaml.py incorrectly reporting
the offending file as the default_config_node projectconfig.yaml
when no name key exists in the pre_config_node dict.

buildstream/_project.py: Report if project.conf is missing name

See merge request !680

This adjusts the message handler for the child processes to no longer
override the message type.

This also removes the ability for unhandled non BstError exceptions to
retry.

Retries log as failures

See merge request !766

This prevents the cache_size.pid.log files from cluttering the root
log directory.

Move cache_size.pid.log files into a subdirectory of logs

See merge request !769

Also highlight the fact that the plugin can rely on the fetcher's
fetch() method getting called before consuming the next item in the
list, which is the magick behavior that the git plugin relies on.

This is a part of #620

A download URL must be interpreted by the core at `Plugin.configure()`
time, even if only employed later on.

This is a part of #620

Keeps track of whether the plugin is currently being configured.

Adjusted Element and Source classes to call _configure() in place
of calling configure() directly.

This is a part of #620

The Source must now mention whether the marked or translated
URL is "primary" or not. Even when a Source may have multiple
URLs, the auxilliary URLs are derived from the primary one, not
only is this true for git, but it is mandated by our tracking
API which assumes there is a primary URL.

This adjusts the `git` source and the test `fetch_source.py` source
to behave properly and advertize it's primary URL properly.

This is a part of #620

This cannot test for unaliased URLs, as those can be discovered later
on outside of user provided element configuration; at least we
assert that if an alias was used, we have seen it at load time.

This will cause a BUG to occur for a plugin which marks an aliased
URL (or attempts to translate one) outside of `Plugin.configure()`,
if that URL was not previously seen.

This is a part of #620

Source fetcher changes

See merge request !772

Add a helper function assert_ref_in_track to git.py GitMirror()
which is used when staging & initing the source workspace. It
checks the element's ref exists in the track (branch/tag) if it
has been specified, raising a warning if necessary. The warning makes
use of the warning token 'REF_NOT_IN_TRACK' from the configurable
CoreWarnings. If the element has been tracked with bst, it is assumed
that the value of ref exists in the track as it was generated from it
& as such is not asserted.

Add tests that cover assert_ref_in_track & the configurable
CoreWarnings REF_NOT_IN_TRACK warnings token.

plugins/git.py: Warn if ref is not in given track

See merge request !564

Jim MacArthur authored Aug 02, 2018 and Martin Blanchard committed Sep 04, 2018

Add helper method for object pushing and pulling: push_directory() and
pull_tree() and a verifier verify_key_pushed().

#454

#454

Jim MacArthur authored Jul 03, 2018 and Martin Blanchard committed Sep 04, 2018

This is for use after remote execution has finished, since remote
execution produces a new output directory rather than modifying
the initial directory.

#454

Jim MacArthur authored Aug 17, 2018 and Martin Blanchard committed Sep 04, 2018

This just adds one option, "remote-execution/url". Affects multiple files.

#454

Jim MacArthur authored Aug 21, 2018 and Martin Blanchard committed Sep 04, 2018

#454

Jim MacArthur authored Jul 05, 2018 and Martin Blanchard committed Sep 04, 2018

The remote execution client is implemented as a remote sandbox that
sends sources and build commands to a REAPI server and fetches results
once remotely executed. New file.

#454

Jim MacArthur authored Aug 14, 2018 and Martin Blanchard committed Sep 04, 2018

#454

Jim MacArthur authored Aug 03, 2018 and Martin Blanchard committed Sep 04, 2018

Executing run() on a sandbox can now replace the virtual directory,
since remote execution returns a potentially different directory rather
than an update to the existing one. Call get_virtual_directory() again
after running to accout for this.

#454

Jim MacArthur authored Aug 17, 2018 and Martin Blanchard committed Sep 04, 2018

#454

Jim MacArthur authored Aug 17, 2018 and Martin Blanchard committed Sep 04, 2018

#454