RFI: GitLab CI configuration with Docker
Overview
We have a customer that would like some assistance with GitLab CI, they're unsure if their current setup provides optional performance. They're also encountering some delays or non-processing of requests when cancelling builds.
This issue will serve as a way to communicate any potential causes of these problems or alternative configurations with support, CI team and customer.
We have been struggling with stability issues with GitLab CI for the past few weeks. For some context, we use GitLab CI to interact with Docker containers, which do all of the specialized work. There are a few specific issues we are experiencing:
- Our builds will fairly often hang in that they are running, but nothing is happening.
- When we cancel the build, the GitLab UI shows the build as cancelled. However, the CI runner still continues. In addition, pending jobs are not picked up to be run. Our administrators need to manually kill to the docker process, after which the pending jobs will be run.
It would be very helpful to have our issues answered. In addition, best practices for running GitLab CI with Docker builds would be great. The documentation offers options; however, just telling us how to do it the right way would be more valuable.
* GitLab version: GitLab Enterprise Edition 8.9.4-ee ea8a665
* gitlab-ci-runner version: 1.3.2
* Docker version:
Client:
Version: 1.11.2
API version: 1.23
Go version: go1.5.4
Git commit: b9f10c9
Built: Wed Jun 1 21:47:50 2016
OS/Arch: linux/amd64
Server:
Version: 1.11.2
API version: 1.23
Go version: go1.5.4
Git commit: b9f10c9
Built: Wed Jun 1 21:47:50 2016
OS/Arch: linux/amd64
* OS for GitLab CI Runner
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
* OS for GitLab: we are running the Docker image gitlab/gitlab-ee:8.9.4-ee.1
Hardware specifications have been requested
- gitlab.rb config.toml: https://drive.google.com/a/gitlab.com/folderview?id=0B_4wYK1qcPT1dUVrdThtNHRtZEk&usp=sharing (gitlab only)
//cc @grzesiek @tmaczukin @ayufan - This issue is non-urgent, any response/support is appreciated. - I know you're all very busy