Skip to content
GitLab
Next
    • GitLab: the DevOps platform
    • Explore GitLab
    • Install GitLab
    • How GitLab compares
    • Get started
    • GitLab docs
    • GitLab Learn
  • Pricing
  • Talk to an expert
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
    Projects Groups Topics Snippets
  • Register
  • Sign in
  • gitlab-runner gitlab-runner
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
    • Locked files
  • Issues 3.5k
    • Issues 3.5k
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 98
    • Merge requests 98
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Artifacts
    • Schedules
    • Test cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
    • Model experiments
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • GitLab.orgGitLab.org
  • gitlab-runnergitlab-runner
  • Issues
  • #2251
Closed
Open
Issue created Mar 17, 2017 by Tobias Knecht@tknecht

"Failed to update executor docker+machine for XXXXXXXX No free machines that can process builds"

Summary

"Failed to update executor docker+machine for 8e48a51b No free machines that can process builds"

even though

root@absx-gce-gitlab-runner:~# docker-machine ls
NAME                                                    ACTIVE   DRIVER   STATE     URL                     SWARM   DOCKER    ERRORS
runner-8e48a51b-absx-scale-runner-1489746821-91eb6745   -        google   Running   tcp://10.132.0.5:2376           v1.12.6

Steps to reproduce

Installed based on this project: https://github.com/jerryjj/gitlab-runner-gce/ (This is old and needs tweaks)

Everything seems to run fine. gitlab-ci-multi-runner starts, fires up the first runner (IdleCount = 1) and immediately starts logging the error: "Failed to update executor docker+machine for 8e48a51b No free machines that can process builds"

Actual behavior

When a build gets started the same machine is being used to build, while a second runner is started to keep IdleCount = 1. When the build is done, 2 machine stays and does not get removed, even though it should based on the IdleTime and IdleCount.

Expected behavior

Why the error? IdleCount should work and runners should be removed.

Relevant logs and/or screenshots

Mar 17 11:46:43 absx-gce-gitlab-runner gitlab-runner[2977]: time="2017-03-17T11:46:43Z" level=info msg="Machine created" name=runner-8e48a51b-absx-scale-runner-1489751144-9f54b587 now=2017-03-17 11:46:43.845891434 +0000 UTC retries=0 time=58.948970057s #012<nil>
Mar 17 11:46:43 absx-gce-gitlab-runner gitlab-ci-multi-runner[2977]: time="2017-03-17T11:46:43Z" level=info msg="Machine created" fields.time=58.948970057s name=runner-8e48a51b-absx-scale-runner-1489751144-9f54b587 now=2017-03-17 11:46:43.845891434 +0000 UTC retries=0 time=58.948970057s
Mar 17 11:46:47 absx-gce-gitlab-runner gitlab-runner[2977]: time="2017-03-17T11:46:47Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds" #012<nil>
Mar 17 11:46:47 absx-gce-gitlab-runner gitlab-ci-multi-runner[2977]: time="2017-03-17T11:46:47Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds"
Mar 17 11:46:50 absx-gce-gitlab-runner gitlab-runner[2977]: time="2017-03-17T11:46:50Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds" #012<nil>
Mar 17 11:46:50 absx-gce-gitlab-runner gitlab-ci-multi-runner[2977]: time="2017-03-17T11:46:50Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds"
Mar 17 11:46:53 absx-gce-gitlab-runner gitlab-runner[2977]: time="2017-03-17T11:46:53Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds" #012<nil>
Mar 17 11:46:53 absx-gce-gitlab-runner gitlab-ci-multi-runner[2977]: time="2017-03-17T11:46:53Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds"
Mar 17 11:46:56 absx-gce-gitlab-runner gitlab-runner[2977]: time="2017-03-17T11:46:56Z" level=warning msg="Failed to update executor docker+machine for 8e48a51b No free machines that can process builds" #012<nil>

Environment description

concurrent = 5
check_interval = 0

[[runners]]
  url = "https://gitlab.com/ci"
  name = "absx-scale-runner"
  token = "8e48a[..]3cfde0"
  executor = "docker+machine"
  limit = 10
  [runners.docker]
    image = "docker:latest"
    privileged = true
    disable_cache = false
    cache_dir = "/cache"
    volumes = ["/cache"]
  [runners.machine]
    OffPeakPeriods = [
       "* * 0-8,20-23 * * mon-fri *",
       "* * * * * sat,sun *"
    ]
    OffPeakIdleCount = 0
    OffPeakIdleTime = 360
    OffPeakTimezone = "Europe/Berlin"
    IdleCount = 1
    IdleTime = 60
    MaxBuilds = 10
    MachineDriver = "google"
    MachineName = "absx-scale-runner-%s"
    MachineOptions = [
      "google-project=abusix-gitlab-ci-scaler",
      "google-zone=europe-west1-c",
      "google-machine-type=n1-standard-4",
      "google-machine-image=coreos-cloud/global/images/coreos-stable-1298-5-0-v20170228",
      "google-tags=gitlab-ci-runner-worker,project-noip",
      "google-preemptible=true",
      "google-use-internal-ip=true",
      "google-use-internal-ip-only=true"
    ]

Used GitLab Runner version

Version: 1.11.1 Git revision: a67a225c Git branch: 1-11-stable GO version: go1.7.5 Built: Fri, 03 Mar 2017 12:35:58 +0000 OS/Arch: linux/amd64

Edited Sep 02, 2020 by 🤖 GitLab Bot 🤖
Assignee
Assign to
Time tracking