Improve fetchers, builders and pushers documentation.

Closes #550.

PullQueue: fix resource used

Closes #550

See merge request !611

Ed Baunton authored Jul 27, 2018 and Tristan Van Berkom committed Aug 07, 2018

Add an optional flag to make files executable after having downloaded them.

Instead of leaving the permissioning of downloaded file in remote.py up
to the user's umask; expressly set permissions to 0644 or 0755 if
executable.

Bump format version to 13.

remote.py: Add support for marking downloaded files executable

See merge request !581

source/install_linux_distro.rst: Make clearer ArchLinux packages available

See merge request !613

Adam Jones authored Jun 29, 2018 and Javier Jardón committed Aug 07, 2018

change code style to ini

Include systemd file examples for google-cas cache

Closes #419

See merge request !524

  - python-arpy is unobtainable via pacman
  - Also a minor change to how we display install instructions
  from Fedora's dnf package manager

Change install instructions for python-arpy package on Arch

See merge request !614

This is to address #471 that
documented unhelpfull behavour when tracking git sources.

Add warning to git track if track and ref are not present

Closes #471

See merge request !580

This reverts commit 4f168b9b.

The latest version of pytest_pylint works fine with pylint 2, which
means there is no longer a reason to restrict the pylint version.

pylint 2 is required for Python 3.7.

Do not rely on `StopIteration` bubbling up.

https://www.python.org/dev/peps/pep-0479/

Python 3.7 support

See merge request !615

.gitlab-ci.yml: Remove unused script "install.sh"

See merge request !617

The CAS uses a temp directory while manipulating the cache, temporary
files can be added and removed while adding artifacts to the cache here.

Since calculation of the cache size happens in parallel to artifact
cache additions, this causes race conditions in the size calculation
job, as we end up calling `stat` on temporary files which are being
removed in parallel.

Handle this by moving the temporary directory out of the way, and avoid
considering the tmp directory when calculating the cache size

Fix race condition when calculating disk usage

See merge request !600

When open(2) is used with flags O_CREAT|O_RDWR, the file descriptor
must be readable. Unfortunately O_RDWR was not passed which made
read fail with EBADF and mmap to signal SIGBUS.

This issue happened with man-db for example.

Fixes #143.

Keep original flags for create in SafeHardlinks.

Closes #143

See merge request !624

Multiprocessing with n_jobs given by multiprocessing.cpu_count() is not optimal for
systems where not all CPU can be used (in particular, Docker, CI etc).

As suggested in the multiprocessing docs
(http://docs.python.org/3/library/multiprocessing.html#multiprocessing.cpu_count)
using len(os.sched_getaffinity(0)) might be better.

even if the machine have mores cores available

Patch taken from YBD: https://gitlab.com/baserock/ybd/blob/master/ybd/app.py#L227

buildstream/_project.py: Restrict max-jobs

See merge request !620

Pin ruamel.yaml version to <= 0.15

See merge request !630

This fixes #191

A note has been added to NEWS explaining backwards
compatibility issues