element.py: Pass bare_directory also to SandboxRemote()

See merge request !928

Fixes: 825963b5 ("element: Make "--sysroot" take a bare directory")

plugins/sources/pip.py: Accomodate characters '-','.','_' for packages

See merge request !914

_yaml.py: Implement `get()` for `ChainMap`

See merge request !919

Since the core Python `ChainMap.get()` implements with:

    self[key] if key in self else default

The double-chain-lookup is expensive.  This simple change solves that
for our ChainMap derived structure.  As such it improves matters
for #466 somewhat.

Signed-off-by: Daniel Silverstone <daniel.silverstone@codethink.co.uk>

BREAK: manual.yaml: don't set any default env vars

Closes #718

See merge request !916

Angelos Evripiotis authored 6 years ago and Tristan Van Berkom committed 6 years ago

Remove the 'MAKEFLAGS' and 'V' defaults.

Now that there is a specialised 'make' element, these make-specific
defaults don't make sense here. This element is meant to be a blank
slate for folks to build on.

Note that this is a breaking change, that will require some users to
make changes to their .bst files if they are expecting these environment
variable to be set.

_versions.py: BST_FORMAT_VERSION bumped to 18.

This fixes issue #718

Remove dependency on pytest-runner

See merge request !886

Benjamin Schubert authored 6 years ago and Benjamin Schubert committed 6 years ago

This includes a new command mimicking pytest-runner so that we
can drop this dependency

This was the only setup_requires dependency that we had and
will make like easier for people behind proxies

_frontend/app.py: Set correct element-path in interactive bst-init

See merge request !912

Jonathan/debug remote failed builds

See merge request !869

This is related to #539

i.e. instead of taking a directory that must contain "root" and
"scratch", and treating "root" as the root, use the directory directly.

In element.py:
* __sandbox takes the `bare_sandbox` arg, to pass into the sandbox's constructor

In sandbox.py:
* If bare_sandbox, `_root` is the passed-in directory, and `__scratch`
  is None.
* Trying to use `__scratch` when bare_sandbox is True is a bug.

In _mount.py:
* Don't get the value of `__scratch` if it's not needed.

This is part of #539

This is related to #539

This includes changes in app.py:
* Interactive failure shell no longer uses the failed build sysroot,
  defaulting to the cached build tree.

Changes in element.py are:
* Errors caused by building don't store the failed build sysroot,
  instead storing that a sandbox can be created to debug the error.
* When staging sources, will stage the element's cached build tree if it
  exists.

Changes in _exceptions.py:
* BstError.sandbox is now a flag of whether a sandbox can be opened up
  to debug the error.

Changes in widget.py:
* Don't try to print any information about the sandbox.

Changes in _message.py:
* Fix documentation so Message.sandbox is not a directory any more.

This is part of #539

We shouldn't need it to persist now that we cache failed build dirs.

This change breaks the test
`tests/integration/shell.py::test_sysroot_workspace_visible`.
I can no longer see a use-case for this test.
AIUI, it tested that the failed build sysroot stored in the builddir has
the workspace's files in, despite the workspace being unmounted.
I believe this behaviour is made redundant by cached buildtrees.

This fixes part of #539

Tristan/architecture docs

See merge request !907

Don't close stdout when running 'checkout' to stdout

Closes #486

See merge request !905

With the new support for saving the stdout FDs cleanly, and binary mode
capture in runcli, enable the tarball-to-stdout test.

Signed-off-by: Daniel Silverstone <daniel.silverstone@codethink.co.uk>

In order to test things which write tarballs to stdout correctly,
we need to capture the binary output cleanly.  This ensures we're not
potentially mismatching encodings in and out.

Signed-off-by: Daniel Silverstone <daniel.silverstone@codethink.co.uk>

In order to support things which might need to use the stdout FD
after checkout has completed writing a tarball to it, preserve it
by means of `os.dup()` and `os.dup2()`

Signed-off-by: Daniel Silverstone <daniel.silverstone@codethink.co.uk>

Fix some ruamel warnings during tests

See merge request !889

Move _sentinel from utils.py to _yaml.py

See merge request !903