Fix rst link formatting for guideline links

See merge request !811

This fixes an issue where the re-instantiated Source used with
Source mirroring enabled is not completely initialized.

Failing to load the ref from the project.refs file for instance,
will result in a crash at `fetch` time.

This fixes issue #666

source.py: Fix re-instantiation

Closes #666

See merge request !817

The check for directory should have always been here. The early warning
test doesn't work for `bst checkout` because caches haven't been configured
at the point of the test, so I've had to remove it.

The return value is always upload_vdir.ref.

Also add docstring to method and remove return value since it was useless

Remote exec: Remove early warning and check directory is not None

See merge request !800

Chandan Singh authored Sep 18, 2018 and Chandan Singh committed Sep 21, 2018

Currently, `source-bundle` command is entirely broken as it tries to stage the
sources in a directory that doesn't exist. Fix it by ensuring that we create
the necessary directories before calling any methods that try to use those
directories.

This fix comes with a regression test to ensure that the basic use-case
of `source-bundle` continues to work in future.

Fixes #651.

Fix source-bundle command

Closes #651

See merge request !807

setup.py: Make website the primary homepage

See merge request !795

The behavior of __assert_cached() was changed when the keystrength
parameter was introduced. This restores the previous behavior.

Fixes #607.

Fixes: 3d308894 ("element.py: Cache the result of checking whether...")

Test rebuild that requires staging of weakly cached dependency.

This is a regression test for #607.

element.py: Fix cache check in non-strict mode

Closes #607

See merge request !822

This adds directory objects to the local repository before downloading
files in the directory. However, artifact references are still stored
only after downloading the complete directory and thus, there won't be
dangling references. This will anyway be required for partial download
support.

gRPC can handle 1 MiB payloads. Increase size limit from 64 KiB to speed
up uploads.`

Use 1 MiB as payload size limit on the server side for both individual
downloads and batch uploads.

This uses BatchReadBlobs instead of individual blob download to speed up
artifact pulling, if the server supports it.

Fixes #554.

_artifactcache/cascache.py: Use BatchReadBlobs

Closes #554

See merge request !813

Also update the documentation for get_virtual_directory to make the
implications of using both methods clearer.

Stop caching virtual directories if get_directory is used.

See merge request !818

Closes #514.

CI: test building freedesktop-sdk overnight

Closes #514

See merge request !826

The current one doesn't build due server being down.

To finish the creation of the Let's Encrypt certificate, which will
allows us to use https://docs.buildstream.build/ for accessing the
documentation.

ci: add ACME challenge

See merge request !831

Imports code.proto from https://github.com/googleapis/googleapis and
corresponding modules generated with ./setup.py build_grpc.

#668

#668

Better handle remote build failures

See merge request !825

Unsupported sandbox config (UID/GID) is now reported by the element.

On systems without user namespace support, elements with unsupported
sandbox config (UID/GID) are now individually tainted, which disables
artifact push.

The artifact cache is no longer platform-specific.

Now that the platform is independent of the context, explicit
instantiation is no longer required. This avoids issues with platform
instances used across test cases with mismatching context.

Make platform independent of context

See merge request !829

Use `git describe` to prefix `ref` with closest tag, if available.

git.py: Make `ref` human readable

See merge request !291

knownexus authored Aug 30, 2018 and Jürg Billeter committed Sep 27, 2018

This has been moved from app.py
As it will have different functionality depending on platform
Once the Darwin (MacOS) platform is added

Removed `resource.setrlimit()` functionality from app.py
Added `resource.setrlimit()` functionality to platform.py as function

knownexus authored Aug 30, 2018 and Jürg Billeter committed Sep 27, 2018

_platform/linux.py: Add FUSE check
And Ensure exception is not raised when performing sandbox availability check
Without this check, WSL would error upon finding FUSE missing
This must be bypassed to allow remote execution

knownexus authored Sep 07, 2018 and Jürg Billeter committed Sep 27, 2018

This is due to Darwin (MacOS) having a different Max-Jobs limit
_platform/platform.py: Adding max-jobs call

_project.py: redirected 'max-jobs' to point at the platform

knownexus authored Sep 18, 2018 and Jürg Billeter committed Sep 27, 2018

This is to allow platforms that do not support sandboxing
To error in a controlled/known way

knownexus authored Aug 30, 2018 and Jürg Billeter committed Sep 27, 2018

Adding functionality to recognise Darwin as a platform in plaform.py

knownexus authored Sep 03, 2018 and Jürg Billeter committed Sep 27, 2018

Non-Linux platforms don't return EISDIR when attempting to unlink a
directory.

Stopped safe_remove attempting to unlink dirs
Previously safe_remove would attempt to unlink a path
Before attempting to remove it if it was a dir

Now it checks for a dir before that step

James Ennis authored Sep 21, 2018 and Jürg Billeter committed Sep 27, 2018

This patch was required due to not being able to execute `bst` on
a Linux machine without FUSE available.

Implement compatibility fixes for MacOSX and WSL Blocks #411 and #412"

See merge request !726

richardmaw-codethink authored Sep 24, 2018 and richardmaw-codethink committed Sep 27, 2018

This test ensures that failed builds are pushed when set to on-error=quit.

Closes #534

tests: Add regression test for pushing failed builds

Closes #534

See merge request !824

The issue happens on Silverblue where /home is a symlink to /var/home.
With this element-path is something like
/var/home/user/project/elements, when the project path is
/home/usr/project. Comparing canonical paths solves the issue.

Fixes #673

Fix outside-of-project check when project path is not canonical.

Closes #673

See merge request !832

data/userconfig.yaml: Document the cache.quota setting

See merge request !833

Comparison between None and integer is not supported.

_platform: Fix get_cpu_count() with cap=None

See merge request !840

For consistency.

Minor CI tweaks

See merge request !842

Fixes #676.

This uses BatchUpdateBlobs instead of individual blob upload to speed up
artifact pushing, if the server supports it.

Fixes #677.

CAS: Implement BatchUpdateBlobs support

Closes #677 and #676

See merge request !839

This matches the other sandbox implementations.

sandbox/_sandboxremote.py: Use helpers to set up cwd and env

See merge request !841

.gitlab-ci.yml: forced pip3 install Sphinx 1.7.9
The theme we use in our docs "sphinx_rtd_theme"
Does not support the latest version of Sphinx (>1.8)
This results in search functionality failing

Fixing: Search functionality in the Documentation has stopped working

Closes #681

See merge request !848

If Sandbox.run() is never called, sandbox config is irrelevant. If it is
called, the build will fail anyway with the dummy sandbox.

This matches the logic in the Darwin platform.

_platform/linux.py: Accept all configs for dummy sandbox

See merge request !843

Tristan Van Berkom authored Oct 02, 2018 and Tristan Van Berkom committed Oct 03, 2018

This will take care of silencing the status messages while checking submodules.

Tristan Van Berkom authored Oct 02, 2018 and Tristan Van Berkom committed Oct 03, 2018

The source fetchers might be a list or a generator, when it is
a generator (like the git source does), then we want to ensure that
we silence the status messages which might occur as a result of
consuming a source fetcher from the generator.

This fixes the logs to be less verbose.

fix status messages

See merge request !845

 * Enhanced the base Job class to bookkeep which jobs have
   been terminated, and to consider them as `skipped` when
   asked via the `skipped` property.

 * Enhanced the base Queue class to bookkeep the job statuses
   more carefully.

This fixes #479

_scheduler: Fix bookkeeping of terminated jobs

Closes #479

See merge request !850

tests: Add regression test for mirroring with project.refs

See merge request !823

Qinusty authored Sep 19, 2018 and Tristan Maat committed Oct 03, 2018

This fixes #634, BuildStream no longer saves workspace configuration on
a failed build.