.gitlab-ci-yml: Add ubuntu 18.04 test

See merge request !523

Fix typo in dev-requirements.txt

See merge request !641

Move development reqirements to dev-requirements.txt

See merge request !637

In some cases, such as when working inside a virtual environment, it can
be desirable to install all dependencies for running tests using `pip`.
This is currently not possible since setuptools does not support
installing these dependencies in a virtual environment (by design).
(See https://stackoverflow.com/a/21003259.)

To circumvent this issue, move such requirements to
`dev-requirements.txt` file that can be used easily with
`pip install -r`. This also enables tests to be run directly using
`pytest`, which can be more convenient than `-addopts` approach when one
needs to add multiple options.

This will also be useful in creating better testuite images, and fix
some of the issues noticed in
buildstream-docker-images!56.

Set environment in bwrap command line instead of its environment

Closes #498

See merge request !565

Valentin David authored 6 years ago and Valentin David committed 6 years ago

Fixes #498

Patch for issue #191 support relative workspaces

Closes #191

See merge request !504

This fixes #191

A note has been added to NEWS explaining backwards
compatibility issues

Pin ruamel.yaml version to <= 0.15

See merge request !630

buildstream/_project.py: Restrict max-jobs

See merge request !620

even if the machine have mores cores available

Patch taken from YBD: https://gitlab.com/baserock/ybd/blob/master/ybd/app.py#L227

Multiprocessing with n_jobs given by multiprocessing.cpu_count() is not optimal for
systems where not all CPU can be used (in particular, Docker, CI etc).

As suggested in the multiprocessing docs
(http://docs.python.org/3/library/multiprocessing.html#multiprocessing.cpu_count)
using len(os.sched_getaffinity(0)) might be better.

Keep original flags for create in SafeHardlinks.

Closes #143

See merge request !624

When open(2) is used with flags O_CREAT|O_RDWR, the file descriptor
must be readable. Unfortunately O_RDWR was not passed which made
read fail with EBADF and mmap to signal SIGBUS.

This issue happened with man-db for example.

Fixes #143.

Fix race condition when calculating disk usage

See merge request !600

The CAS uses a temp directory while manipulating the cache, temporary
files can be added and removed while adding artifacts to the cache here.

Since calculation of the cache size happens in parallel to artifact
cache additions, this causes race conditions in the size calculation
job, as we end up calling `stat` on temporary files which are being
removed in parallel.

Handle this by moving the temporary directory out of the way, and avoid
considering the tmp directory when calculating the cache size

.gitlab-ci.yml: Remove unused script "install.sh"

See merge request !617

Python 3.7 support

See merge request !615

Do not rely on `StopIteration` bubbling up.

https://www.python.org/dev/peps/pep-0479/

This reverts commit 4f168b9b.

The latest version of pytest_pylint works fine with pylint 2, which
means there is no longer a reason to restrict the pylint version.

pylint 2 is required for Python 3.7.

Add warning to git track if track and ref are not present

Closes #471

See merge request !580

This is to address #471 that
documented unhelpfull behavour when tracking git sources.

Change install instructions for python-arpy package on Arch

See merge request !614

  - python-arpy is unobtainable via pacman
  - Also a minor change to how we display install instructions
  from Fedora's dnf package manager

Include systemd file examples for google-cas cache

Closes #419

See merge request !524

Adam Jones authored 6 years ago and Javier Jardón committed 6 years ago

change code style to ini

source/install_linux_distro.rst: Make clearer ArchLinux packages available

See merge request !613

remote.py: Add support for marking downloaded files executable

See merge request !581

Ed Baunton authored 6 years ago and Tristan Van Berkom committed 6 years ago

Add an optional flag to make files executable after having downloaded them.

Instead of leaving the permissioning of downloaded file in remote.py up
to the user's umask; expressly set permissions to 0644 or 0755 if
executable.

Bump format version to 13.

PullQueue: fix resource used

Closes #550

See merge request !611

Improve fetchers, builders and pushers documentation.

Closes #550.

Fix two links in the installing docs

See merge request !610