Request_concurrency causes fleeting plugin not scale down idle instances properly
Summary
When I set request_concurrency > 1 it causes that same number of instances are always running, when fleeting plugin is used.
I was dealing an issue, that GitLab runner is not picking up new jobs. It happens when large amount (hundereds) of jobs are in pending state, Gitlab runner is not picking up new jobs. Even than it could just start a new instance via fleeting plugin, but it wount.
So I raised the requests_concurrency from default 1 to lets say 4, it starts picking a new jobs imidieataly. But the ASG in AWS starts to scaling up and down. From 3 to 4 and back. Even after there is basically no job available.
Steps to reproduce
Run gitlab with this configuration and start few jobs.
.gitlab-ci.yml
check_interval = 0
concurrent = 16
shutdown_timeout = 0
listen_address = ":9252"
[session_server]
session_timeout = 1800
[[runners]]
name = "GitLabCiRunner-2xlarge"
url = "https://gitlab.com/"
token = "<reducted>"
token_obtained_at = 2023-06-04T12:50:45Z
token_expires_at = 0001-01-01T00:00:00Z
pre_build_script = "source /pre_build_script.sh"
executor = "docker-autoscaler"
request_concurrency = 4
limit = 16
[runners.cache]
MaxUploadedArchiveSize = 0
Type = "s3"
Path = "cache"
Shared = true
[runners.cache.s3]
ServerAddress = "s3.amazonaws.com"
BucketName = "<reducted>"
BucketLocation = "eu-central-1"
Insecure = false
[runners.docker]
tls_verify = false
image = "docker:latest"
privileged = true
disable_entrypoint_overwrite = false
oom_kill_disable = false
disable_cache = false
cache_dir = "/mnt/tmp-cache"
pull_policy = "always"
volumes = [
<reducted>
]
[runners.autoscaler]
plugin = "fleeting-plugin-aws"
capacity_per_instance = 1
max_use_count = 1000
[runners.autoscaler.plugin_config]
name = "<reducted>"
profile = "default"
[runners.autoscaler.connector_config]
username = "ubuntu"
use_external_addr = false
[[runners.autoscaler.policy]]
idle_count = 0
idle_time = "20m0s"`## Actual behavior
When request_concurrency > 1 AWS ASG is scaled up and down. To request_concurrency number of instances.
Expected behavior
Should just run parallel requests to Gitlab.com. Nothing more. When there is not work, GitLab Runner should respect the idle_count
Relevant logs and/or screenshots
Logs
2023-12-10T05:53:11.115Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 lifetime=21m21.939643728s
2023-12-10T05:52:38.498Z [INFO] ready: instance=i-08930e8acd483fe0d took=9.622808777s
2023-12-10T05:52:28.876Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08930e8acd483fe0d state=running
2023-12-10T05:52:22.421Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08930e8acd483fe0d state=creating cause=requested
2023-12-10T05:52:09.433Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:52:09.433Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:52:09.325Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:52:09.325Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 state=deleting
2023-12-10T05:52:09.030Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:51:09.007Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08b4e4259f2361c8a lifetime=20m59.772629579s
2023-12-10T05:50:59.656Z [INFO] ready: instance=i-09052652744413592 took=11.271331539s
2023-12-10T05:50:48.385Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09052652744413592 state=running
2023-12-10T05:50:42.959Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09052652744413592 state=creating cause=requested
2023-12-10T05:50:27.815Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:50:27.815Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
Submitting job to coordinator...accepted, but not yet completed bytesize=4129 checksum=crc32:d23f742c code=202 job=5719216348 job-status= runner=WXyxARvv u
Updating job... bytesize=4129 checksum=crc32:d23f742c job=5719216348 runner=WXyxARvv
Appending trace to coordinator...ok code=202 job=5719216348 job-log=0-4129 job-status=running runner=WXyxARvv sent-log=364-4128 status=202 A
Job succeeded duration_s=33.724873921 job=5719216348 project=5911115 runner=WXyxARvv
Dialing instance external-address=18.184.95.26 instance-id=i-0758487514ac20999 internal-address=10.12.4.63 job=5719216348
Appending trace to coordinator...ok code=202 job=5719216348 job-log=0-364 job-status=running runner=WXyxARvv sent-log=0-363 status=202 Accep
Preparing instance... job=5719216348 project=5911115 runner=WXyxARvv
Added job to processing list builds=1 job=5719216348 max_builds=16 project=5911115 repo_url=https://gitlab.com/signageos/infra/kubern
Checking for jobs... received job=5719216348 repo_url=https://gitlab.com/signageos/infra/kubernetes.git runner=WXyxARvv
Removed job from processing list builds=0 job=5719216343 max_builds=16 project=5911115 repo_url=https://gitlab.com/signageos/infra/kubern
Submitting job to coordinator...ok bytesize=4191 checksum=crc32:aa1953a0 code=200 job=5719216343 job-status= runner=WXyxARvv update-interva
Updating job... bytesize=4191 checksum=crc32:aa1953a0 job=5719216343 runner=WXyxARvv
Submitting job to coordinator...accepted, but not yet completed bytesize=4191 checksum=crc32:aa1953a0 code=202 job=5719216343 job-status= runner=WXyxARvv u
Updating job... bytesize=4191 checksum=crc32:aa1953a0 job=5719216343 runner=WXyxARvv
Appending trace to coordinator...ok code=202 job=5719216343 job-log=0-4191 job-status=running runner=WXyxARvv sent-log=3224-4190 status=202
Job succeeded duration_s=74.637877521 job=5719216343 project=5911115 runner=WXyxARvv
Appending trace to coordinator...ok code=202 job=5719216343 job-log=0-3224 job-status=running runner=WXyxARvv sent-log=364-3223 status=202 A
2023-12-10T06:03:49.544Z [INFO] ready: instance=i-0ade3f33b274017c5 took=19.723166981s
2023-12-10T06:03:29.821Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ade3f33b274017c5 state=running
2023-12-10T06:03:23.282Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ade3f33b274017c5 state=creating cause=requested
2023-12-10T06:03:12.512Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T06:03:12.511Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T06:03:12.358Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
Dialing instance external-address=18.184.95.26 instance-id=i-0758487514ac20999 internal-address=10.12.4.63 job=5719216343
Appending trace to coordinator...ok code=202 job=5719216343 job-log=0-364 job-status=running runner=WXyxARvv sent-log=0-363 status=202 Accep
Preparing instance... job=5719216343 project=5911115 runner=WXyxARvv
Added job to processing list builds=1 job=5719216343 max_builds=16 project=5911115 repo_url=https://gitlab.com/signageos/infra/kubern
Checking for jobs... received job=5719216343 repo_url=https://gitlab.com/signageos/infra/kubernetes.git runner=WXyxARvv
2023-12-10T05:53:11.115Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 lifetime=21m21.939643728s
2023-12-10T05:52:38.498Z [INFO] ready: instance=i-08930e8acd483fe0d took=9.622808777s
2023-12-10T05:52:28.876Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08930e8acd483fe0d state=running
2023-12-10T05:52:22.421Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08930e8acd483fe0d state=creating cause=requested
2023-12-10T05:52:09.433Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:52:09.433Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:52:09.325Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:52:09.325Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 state=deleting
2023-12-10T05:52:09.030Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:51:09.007Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08b4e4259f2361c8a lifetime=20m59.772629579s
2023-12-10T05:50:59.656Z [INFO] ready: instance=i-09052652744413592 took=11.271331539s
2023-12-10T05:50:48.385Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09052652744413592 state=running
2023-12-10T05:50:42.959Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09052652744413592 state=creating cause=requested
2023-12-10T05:50:27.815Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:50:27.815Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:50:27.651Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:50:26.524Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08b4e4259f2361c8a state=deleting
2023-12-10T05:50:26.234Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:49:27.211Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bf28775f890ec844 lifetime=20m58.152387736s
2023-12-10T05:49:25.607Z [INFO] ready: instance=i-041fff97b3ea62a40 took=16.764704746s
2023-12-10T05:49:08.842Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-041fff97b3ea62a40 state=running
2023-12-10T05:49:02.410Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-041fff97b3ea62a40 state=creating cause=requested
2023-12-10T05:48:46.184Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:48:46.184Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:48:46.050Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:48:44.992Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bf28775f890ec844 state=deleting
2023-12-10T05:48:44.657Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:47:45.638Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-020820abb7e789378 lifetime=20m57.325144015s
2023-12-10T05:47:23.716Z [INFO] ready: instance=i-0758487514ac20999 took=6.248129667s
2023-12-10T05:47:17.468Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0758487514ac20999 state=running
2023-12-10T05:47:11.993Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0758487514ac20999 state=creating cause=requested
2023-12-10T05:47:03.293Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:47:03.293Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:47:03.141Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:47:03.141Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-020820abb7e789378 state=deleting
2023-12-10T05:47:02.811Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:32:24.022Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e6926bc6b5aa40fa lifetime=20m56.44355139s
2023-12-10T05:31:57.984Z [INFO] ready: instance=i-0b333e8e15f081802 took=3.362287725s
2023-12-10T05:31:54.622Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 state=running
2023-12-10T05:31:49.175Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b333e8e15f081802 state=creating cause=requested
2023-12-10T05:31:42.687Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:31:42.686Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:31:42.577Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:31:41.517Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e6926bc6b5aa40fa state=deleting
2023-12-10T05:31:41.266Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:30:44.051Z [INFO] ready: instance=i-08b4e4259f2361c8a took=29.358621001s
2023-12-10T05:30:21.148Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-047440f53445f909c lifetime=20m33.3657206s
2023-12-10T05:30:14.693Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08b4e4259f2361c8a state=running
2023-12-10T05:30:09.235Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08b4e4259f2361c8a state=creating cause=requested
2023-12-10T05:30:00.439Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:30:00.439Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:30:00.314Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:29:59.218Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-047440f53445f909c state=deleting
2023-12-10T05:29:58.905Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:29:18.891Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0061116d7e097e45b lifetime=21m11.973033432s
2023-12-10T05:28:59.069Z [INFO] ready: instance=i-0bf28775f890ec844 took=24.589820406s
2023-12-10T05:28:34.479Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bf28775f890ec844 state=running
2023-12-10T05:28:29.059Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bf28775f890ec844 state=creating cause=requested
2023-12-10T05:28:18.269Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:28:18.269Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:28:18.111Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:28:17.031Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0061116d7e097e45b state=deleting
2023-12-10T05:28:16.734Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:27:17.709Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-000a595fb3f50b495 lifetime=20m52.412610853s
2023-12-10T05:26:58.713Z [INFO] ready: instance=i-020820abb7e789378 took=3.856331767s
2023-12-10T05:26:54.857Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-020820abb7e789378 state=running
2023-12-10T05:26:48.313Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-020820abb7e789378 state=creating cause=requested
2023-12-10T05:26:36.413Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:26:36.412Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:26:36.191Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:26:35.121Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-000a595fb3f50b495 state=deleting
2023-12-10T05:26:34.815Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:11:59.971Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01487920812f02772 lifetime=20m56.096343541s
2023-12-10T05:11:40.172Z [INFO] ready: instance=i-0e6926bc6b5aa40fa took=7.218080607s
2023-12-10T05:11:32.954Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e6926bc6b5aa40fa state=running
2023-12-10T05:11:27.579Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e6926bc6b5aa40fa state=creating cause=requested
2023-12-10T05:11:18.792Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:11:18.792Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:11:18.642Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:11:17.570Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01487920812f02772 state=deleting
2023-12-10T05:11:17.262Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:10:18.237Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0525b0c49af0f16a6 lifetime=20m54.471294281s
2023-12-10T05:10:08.813Z [INFO] ready: instance=i-047440f53445f909c took=15.577611224s
2023-12-10T05:09:53.235Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-047440f53445f909c state=running
2023-12-10T05:09:47.782Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-047440f53445f909c state=creating cause=requested
2023-12-10T05:09:36.958Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:09:36.958Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:09:36.818Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:09:35.735Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0525b0c49af0f16a6 state=deleting
2023-12-10T05:09:35.435Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:08:36.408Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-04dfa5af17f21b100 lifetime=21m4.050287291s
2023-12-10T05:08:16.483Z [INFO] ready: instance=i-0061116d7e097e45b took=4.125740902s
2023-12-10T05:08:12.358Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0061116d7e097e45b state=running
2023-12-10T05:08:06.918Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0061116d7e097e45b state=creating cause=requested
2023-12-10T05:07:55.068Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:07:55.068Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:07:54.901Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:07:53.796Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-04dfa5af17f21b100 state=deleting
2023-12-10T05:07:53.413Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:07:14.399Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d3f0f2f2a3929084 lifetime=21m10.064118921s
2023-12-10T05:06:51.441Z [INFO] ready: instance=i-000a595fb3f50b495 took=20.710696112s
2023-12-10T05:06:30.730Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-000a595fb3f50b495 state=running
2023-12-10T05:06:25.296Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-000a595fb3f50b495 state=creating cause=requested
2023-12-10T05:06:13.287Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T05:06:13.287Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T05:06:13.085Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T05:06:12.011Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d3f0f2f2a3929084 state=deleting
2023-12-10T05:06:11.760Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:51:56.120Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d1bfb2e61b5761ad lifetime=21m24.486347958s
2023-12-10T04:51:33.023Z [INFO] ready: instance=i-01487920812f02772 took=22.606258767s
2023-12-10T04:51:10.416Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01487920812f02772 state=running
2023-12-10T04:51:03.874Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01487920812f02772 state=creating cause=requested
2023-12-10T04:50:55.186Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:50:55.186Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:50:55.032Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:50:53.936Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d1bfb2e61b5761ad state=deleting
2023-12-10T04:50:53.694Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:50:13.682Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b72e70f03ac6c421 lifetime=21m22.675819319s
2023-12-10T04:49:34.415Z [INFO] ready: instance=i-0525b0c49af0f16a6 took=5.21123693s
2023-12-10T04:49:29.204Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0525b0c49af0f16a6 state=running
2023-12-10T04:49:23.766Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0525b0c49af0f16a6 state=creating cause=requested
2023-12-10T04:49:12.900Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:49:12.900Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:49:12.772Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:49:11.680Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b72e70f03ac6c421 state=deleting
2023-12-10T04:49:11.402Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:48:11.384Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08c6cbba86dbe195e lifetime=20m59.717862331s
2023-12-10T04:47:43.374Z [INFO] ready: instance=i-04dfa5af17f21b100 took=4.574238574s
2023-12-10T04:47:38.800Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-04dfa5af17f21b100 state=running
2023-12-10T04:47:32.357Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-04dfa5af17f21b100 state=creating cause=requested
2023-12-10T04:47:30.174Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:47:30.174Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:47:30.023Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:47:28.977Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08c6cbba86dbe195e state=deleting
2023-12-10T04:47:28.706Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:46:46.692Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08de5b9e226b5b638 lifetime=21m15.072381759s
2023-12-10T04:46:17.887Z [INFO] ready: instance=i-0d3f0f2f2a3929084 took=8.144674801s
2023-12-10T04:46:09.742Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d3f0f2f2a3929084 state=running
2023-12-10T04:46:04.334Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d3f0f2f2a3929084 state=creating cause=requested
2023-12-10T04:45:57.885Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:45:57.885Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:45:57.754Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:45:44.284Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08de5b9e226b5b638 state=deleting
2023-12-10T04:45:43.994Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:31:28.249Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-086db38c2a1c936a0 lifetime=21m17.517903544s
2023-12-10T04:31:03.629Z [INFO] ready: instance=i-0d1bfb2e61b5761ad took=26.534840991s
2023-12-10T04:30:37.094Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d1bfb2e61b5761ad state=running
2023-12-10T04:30:31.634Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0d1bfb2e61b5761ad state=creating cause=requested
2023-12-10T04:30:27.314Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:30:27.314Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:30:27.158Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:30:26.084Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-086db38c2a1c936a0 state=deleting
2023-12-10T04:30:25.732Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:29:26.711Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-075609f3e6bf2e10d lifetime=20m57.323720846s
2023-12-10T04:29:23.263Z [INFO] ready: instance=i-0b72e70f03ac6c421 took=26.787362032s
2023-12-10T04:28:56.475Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b72e70f03ac6c421 state=running
2023-12-10T04:28:51.007Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0b72e70f03ac6c421 state=creating cause=requested
2023-12-10T04:28:45.598Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:28:45.598Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:28:45.470Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:28:44.421Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-075609f3e6bf2e10d state=deleting
2023-12-10T04:28:44.152Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:27:44.134Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0476aa06dfc6c18dc lifetime=20m53.896805841s
2023-12-10T04:27:40.603Z [INFO] ready: instance=i-08c6cbba86dbe195e took=23.51686375s
2023-12-10T04:27:17.086Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08c6cbba86dbe195e state=running
2023-12-10T04:27:11.666Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08c6cbba86dbe195e state=creating cause=requested
2023-12-10T04:27:02.996Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:27:02.996Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:27:02.857Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:27:01.768Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0476aa06dfc6c18dc state=deleting
2023-12-10T04:27:01.484Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:26:21.473Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ac206b5f9ccf287f lifetime=21m11.767299467s
2023-12-10T04:25:50.740Z [INFO] ready: instance=i-08de5b9e226b5b638 took=13.624650373s
2023-12-10T04:25:37.115Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08de5b9e226b5b638 state=running
2023-12-10T04:25:31.620Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08de5b9e226b5b638 state=creating cause=requested
2023-12-10T04:25:20.681Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:25:20.681Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:25:20.581Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:25:19.444Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ac206b5f9ccf287f state=deleting
2023-12-10T04:25:19.165Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:10:44.261Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0453041a4e98c8ee7 lifetime=20m57.556387551s
2023-12-10T04:10:39.230Z [INFO] ready: instance=i-086db38c2a1c936a0 took=23.096898744s
2023-12-10T04:10:16.133Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-086db38c2a1c936a0 state=running
2023-12-10T04:10:10.731Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-086db38c2a1c936a0 state=creating cause=requested
2023-12-10T04:10:01.965Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:10:01.965Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:10:01.773Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:10:01.773Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0453041a4e98c8ee7 state=deleting
2023-12-10T04:10:01.525Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:08:57.068Z [INFO] ready: instance=i-075609f3e6bf2e10d took=21.167846627s
2023-12-10T04:08:41.405Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-021bff8d0b80cfca7 lifetime=20m35.288425215s
2023-12-10T04:08:35.900Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-075609f3e6bf2e10d state=running
2023-12-10T04:08:29.387Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-075609f3e6bf2e10d state=creating cause=requested
2023-12-10T04:08:20.676Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:08:20.675Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:08:20.527Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:08:19.408Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-021bff8d0b80cfca7 state=deleting
2023-12-10T04:08:19.137Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:07:39.127Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bfaf0fd061a2780c lifetime=21m12.580555129s
2023-12-10T04:06:59.007Z [INFO] ready: instance=i-0476aa06dfc6c18dc took=3.301210717s
2023-12-10T04:06:55.706Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0476aa06dfc6c18dc state=running
2023-12-10T04:06:50.238Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0476aa06dfc6c18dc state=creating cause=requested
2023-12-10T04:06:38.216Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:06:38.216Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:06:38.072Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:06:36.962Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bfaf0fd061a2780c state=deleting
2023-12-10T04:06:36.667Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:05:57.650Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0105c1fab5493ee99 lifetime=21m21.30222186s
2023-12-10T04:05:28.720Z [INFO] ready: instance=i-0ac206b5f9ccf287f took=13.51914361s
2023-12-10T04:05:15.201Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ac206b5f9ccf287f state=running
2023-12-10T04:05:09.705Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ac206b5f9ccf287f state=creating cause=requested
2023-12-10T04:04:56.665Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T04:04:56.665Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T04:04:56.542Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T04:04:55.434Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0105c1fab5493ee99 state=deleting
2023-12-10T04:04:55.088Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:51:00.255Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0402304119f311e44 lifetime=21m45.702494907s
2023-12-10T03:50:22.856Z [INFO] ready: instance=i-0453041a4e98c8ee7 took=30.728059687s
2023-12-10T03:49:52.128Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0453041a4e98c8ee7 state=running
2023-12-10T03:49:46.704Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0453041a4e98c8ee7 state=creating cause=requested
2023-12-10T03:49:39.079Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:49:39.079Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:49:38.973Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:49:37.871Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0402304119f311e44 state=deleting
2023-12-10T03:49:37.628Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:48:38.609Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-042fcd257eb71a57b lifetime=21m4.191153369s
2023-12-10T03:48:20.697Z [INFO] ready: instance=i-021bff8d0b80cfca7 took=8.063058395s
2023-12-10T03:48:12.634Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-021bff8d0b80cfca7 state=running
2023-12-10T03:48:06.116Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-021bff8d0b80cfca7 state=creating cause=requested
2023-12-10T03:47:57.350Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:47:57.350Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:47:57.196Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:47:56.092Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-042fcd257eb71a57b state=deleting
2023-12-10T03:47:55.841Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:47:35.837Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0256286414d78a4f6 lifetime=21m41.215081982s
2023-12-10T03:47:07.571Z [INFO] ready: instance=i-0bfaf0fd061a2780c took=35.596226302s
2023-12-10T03:46:31.974Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bfaf0fd061a2780c state=running
2023-12-10T03:46:26.546Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0bfaf0fd061a2780c state=creating cause=requested
2023-12-10T03:46:14.695Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:46:14.695Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:46:14.545Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:46:13.454Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0256286414d78a4f6 state=deleting
2023-12-10T03:46:13.166Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:45:11.839Z [INFO] ready: instance=i-0105c1fab5493ee99 took=28.968794341s
2023-12-10T03:45:11.063Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08d9077296162da29 lifetime=20m57.139761683s
2023-12-10T03:44:42.870Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0105c1fab5493ee99 state=running
2023-12-10T03:44:36.347Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0105c1fab5493ee99 state=creating cause=requested
2023-12-10T03:44:29.813Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:44:29.813Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:44:29.708Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:44:28.626Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08d9077296162da29 state=deleting
2023-12-10T03:44:28.320Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:29:52.427Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09fd193a507bb4083 lifetime=20m48.907900993s
2023-12-10T03:29:28.595Z [INFO] ready: instance=i-0402304119f311e44 took=7.505154187s
2023-12-10T03:29:21.089Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0402304119f311e44 state=running
2023-12-10T03:29:14.552Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0402304119f311e44 state=creating cause=requested
2023-12-10T03:29:11.339Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:29:11.339Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:29:11.233Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:29:10.150Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09fd193a507bb4083 state=deleting
2023-12-10T03:29:09.876Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:28:30.862Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e660dfde7256b4e2 lifetime=21m18.670004797s
2023-12-10T03:28:05.675Z [INFO] ready: instance=i-042fcd257eb71a57b took=25.840443418s
2023-12-10T03:27:39.834Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-042fcd257eb71a57b state=running
2023-12-10T03:27:34.418Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-042fcd257eb71a57b state=creating cause=requested
2023-12-10T03:27:30.122Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:27:30.121Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:27:29.927Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:27:28.823Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e660dfde7256b4e2 state=deleting
2023-12-10T03:27:28.587Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:27:09.582Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-07e78b5fb7260b4d0 lifetime=21m37.717931768s
2023-12-10T03:26:15.972Z [INFO] ready: instance=i-0256286414d78a4f6 took=15.960919907s
2023-12-10T03:26:00.009Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0256286414d78a4f6 state=running
2023-12-10T03:25:54.622Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0256286414d78a4f6 state=creating cause=requested
2023-12-10T03:25:48.101Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:25:48.101Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:25:47.912Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:25:46.840Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-07e78b5fb7260b4d0 state=deleting
2023-12-10T03:25:46.522Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:24:46.504Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0123067a451b12eaf lifetime=20m54.281112176s
2023-12-10T03:24:24.321Z [INFO] ready: instance=i-08d9077296162da29 took=3.91627904s
2023-12-10T03:24:20.404Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08d9077296162da29 state=running
2023-12-10T03:24:13.924Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-08d9077296162da29 state=creating cause=requested
2023-12-10T03:24:05.297Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:24:05.297Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:24:05.153Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:24:04.084Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0123067a451b12eaf state=deleting
2023-12-10T03:24:03.784Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:09:47.919Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0be966c86139c6448 lifetime=22m11.640709008s
2023-12-10T03:09:13.525Z [INFO] ready: instance=i-09fd193a507bb4083 took=4.519046308s
2023-12-10T03:09:09.006Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09fd193a507bb4083 state=running
2023-12-10T03:09:03.519Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-09fd193a507bb4083 state=creating cause=requested
2023-12-10T03:08:47.190Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:08:47.190Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:08:47.083Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:08:45.997Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0be966c86139c6448 state=deleting
2023-12-10T03:08:45.678Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:08:06.663Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01db70acbc8962218 lifetime=21m15.9932472s
2023-12-10T03:07:43.997Z [INFO] ready: instance=i-0e660dfde7256b4e2 took=26.438872072s
2023-12-10T03:07:17.558Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e660dfde7256b4e2 state=running
2023-12-10T03:07:12.192Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e660dfde7256b4e2 state=creating cause=requested
2023-12-10T03:07:05.613Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:07:05.613Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:07:05.486Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:07:04.417Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01db70acbc8962218 state=deleting
2023-12-10T03:07:04.129Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:06:44.120Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e355ef4e6789d9da lifetime=21m32.485613521s
2023-12-10T03:05:45.756Z [INFO] ready: instance=i-07e78b5fb7260b4d0 took=7.502587099s
2023-12-10T03:05:38.254Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-07e78b5fb7260b4d0 state=running
2023-12-10T03:05:31.864Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-07e78b5fb7260b4d0 state=creating cause=requested
2023-12-10T03:05:23.241Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:05:23.241Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:05:23.072Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:05:22.008Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e355ef4e6789d9da state=deleting
2023-12-10T03:05:21.703Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:05:02.695Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-022d73407b8ab826d lifetime=21m42.426249459s
2023-12-10T03:04:23.009Z [INFO] ready: instance=i-0123067a451b12eaf took=25.352986169s
2023-12-10T03:03:57.656Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0123067a451b12eaf state=running
2023-12-10T03:03:52.223Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0123067a451b12eaf state=creating cause=requested
2023-12-10T03:03:41.318Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T03:03:41.318Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T03:03:41.169Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T03:03:40.049Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-022d73407b8ab826d state=deleting
2023-12-10T03:03:39.822Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:48:32.904Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ea6cc060066a9f0 lifetime=21m18.709690664s
2023-12-10T02:47:54.314Z [INFO] ready: instance=i-0be966c86139c6448 took=12.517153854s
2023-12-10T02:47:41.796Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0be966c86139c6448 state=running
2023-12-10T02:47:36.278Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0be966c86139c6448 state=creating cause=requested
2023-12-10T02:47:32.017Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:47:32.017Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:47:31.892Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:47:30.820Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ea6cc060066a9f0 state=deleting
2023-12-10T02:47:30.608Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:47:14.672Z [INFO] ready: instance=i-01db70acbc8962218 took=17.441120387s
2023-12-10T02:47:01.597Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ce4ec81b229a7b99 lifetime=20m43.529909083s
2023-12-10T02:46:57.231Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01db70acbc8962218 state=running
2023-12-10T02:46:50.670Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01db70acbc8962218 state=creating cause=requested
2023-12-10T02:46:39.841Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:46:39.841Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:46:39.735Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:46:39.734Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ce4ec81b229a7b99 state=deleting
2023-12-10T02:46:39.443Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:45:39.444Z [INFO] ready: instance=i-0e355ef4e6789d9da took=22.346656772s
2023-12-10T02:45:36.343Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01c4708811c6ee04f lifetime=20m57.363676149s
2023-12-10T02:45:17.097Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e355ef4e6789d9da state=running
2023-12-10T02:45:11.635Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0e355ef4e6789d9da state=creating cause=requested
2023-12-10T02:45:07.290Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:45:07.290Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:45:07.124Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:44:54.195Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01c4708811c6ee04f state=deleting
2023-12-10T02:44:53.946Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:43:54.924Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-098753846fc883b22 lifetime=20m56.468102473s
2023-12-10T02:43:35.112Z [INFO] ready: instance=i-022d73407b8ab826d took=8.326618704s
2023-12-10T02:43:26.785Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-022d73407b8ab826d state=running
2023-12-10T02:43:20.269Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-022d73407b8ab826d state=creating cause=requested
2023-12-10T02:43:13.709Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:43:13.709Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:43:13.594Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:43:12.529Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-098753846fc883b22 state=deleting
2023-12-10T02:43:12.254Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:28:06.340Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0fdabf13c5fa1c66c lifetime=21m13.591744691s
2023-12-10T02:27:27.448Z [INFO] ready: instance=i-06ea6cc060066a9f0 took=6.74569764s
2023-12-10T02:27:20.702Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ea6cc060066a9f0 state=running
2023-12-10T02:27:14.195Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ea6cc060066a9f0 state=creating cause=requested
2023-12-10T02:27:05.513Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:27:05.513Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:27:05.365Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:27:04.291Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0fdabf13c5fa1c66c state=deleting
2023-12-10T02:27:04.031Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:26:55.026Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06732c1db01fda46b lifetime=21m53.694665308s
2023-12-10T02:26:49.926Z [INFO] ready: instance=i-0ce4ec81b229a7b99 took=25.330529431s
2023-12-10T02:26:24.596Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ce4ec81b229a7b99 state=running
2023-12-10T02:26:18.067Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0ce4ec81b229a7b99 state=creating cause=requested
2023-12-10T02:26:13.715Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:26:13.715Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:26:13.567Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:26:12.480Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06732c1db01fda46b state=deleting
2023-12-10T02:26:12.213Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:25:34.198Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0a346717b0cc51b16 lifetime=21m18.926179628s
2023-12-10T02:25:04.251Z [INFO] ready: instance=i-01c4708811c6ee04f took=19.84658075s
2023-12-10T02:24:44.405Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01c4708811c6ee04f state=running
2023-12-10T02:24:38.980Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-01c4708811c6ee04f state=creating cause=requested
2023-12-10T02:24:32.511Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:24:32.511Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:24:32.315Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:24:31.217Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0a346717b0cc51b16 state=deleting
2023-12-10T02:24:30.976Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:23:30.959Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-080b42e383a26b9f7 lifetime=20m55.39454082s
2023-12-10T02:23:16.664Z [INFO] ready: instance=i-098753846fc883b22 took=11.633538724s
2023-12-10T02:23:05.030Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-098753846fc883b22 state=running
2023-12-10T02:22:58.455Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-098753846fc883b22 state=creating cause=requested
2023-12-10T02:22:49.740Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:22:49.740Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:22:49.534Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:22:48.463Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-080b42e383a26b9f7 state=deleting
2023-12-10T02:22:48.197Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:07:22.175Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-008966e134d40a368 lifetime=27m29.210438223s
2023-12-10T02:07:09.396Z [INFO] ready: instance=i-0fdabf13c5fa1c66c took=11.238463241s
2023-12-10T02:06:58.157Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0fdabf13c5fa1c66c state=running
2023-12-10T02:06:52.749Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0fdabf13c5fa1c66c state=creating cause=requested
2023-12-10T02:06:39.787Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:06:39.787Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:06:39.641Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:06:39.640Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-008966e134d40a368 state=deleting
2023-12-10T02:06:39.357Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:05:59.344Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0f0b59d0dd4605094 lifetime=2h19m8.419087787s
2023-12-10T02:05:28.710Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0071c0d7c5499f4ca lifetime=22m4.039134109s
2023-12-10T02:05:20.484Z [INFO] ready: instance=i-06732c1db01fda46b took=13.637012049s
2023-12-10T02:05:06.847Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06732c1db01fda46b state=running
2023-12-10T02:05:01.331Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06732c1db01fda46b state=creating cause=requested
2023-12-10T02:04:58.119Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:04:58.119Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:04:57.953Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:04:56.898Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0f0b59d0dd4605094 state=deleting
2023-12-10T02:04:56.593Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:04:29.522Z [INFO] ready: instance=i-0a346717b0cc51b16 took=7.732292449s
2023-12-10T02:04:21.790Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0a346717b0cc51b16 state=running
2023-12-10T02:04:15.272Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0a346717b0cc51b16 state=creating cause=requested
2023-12-10T02:04:07.596Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:04:07.596Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:04:07.448Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:04:06.399Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-0071c0d7c5499f4ca state=deleting
2023-12-10T02:04:06.085Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:03:06.059Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ced18b55190b050 lifetime=22m26.639973087s
2023-12-10T02:02:49.059Z [INFO] ready: instance=i-080b42e383a26b9f7 took=6.970043485s
2023-12-10T02:02:42.088Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-080b42e383a26b9f7 state=running
2023-12-10T02:02:35.564Z [INFO] instance discovery: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-080b42e383a26b9f7 state=creating cause=requested
2023-12-10T02:02:25.675Z [INFO] increase update: group=aws/eu-central-1/GitLabCiWorker-2xlarge pending=1 total_pending=1 requesting=0
2023-12-10T02:02:25.675Z [INFO] increasing instances response: group=aws/eu-central-1/GitLabCiWorker-2xlarge num_requested=1 num_successful=1
2023-12-10T02:02:25.507Z [INFO] increasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:02:24.408Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06ced18b55190b050 state=deleting
2023-12-10T02:02:24.079Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:01:45.061Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-05096ae3d934cfb44 lifetime=21m5.641988046s
2023-12-10T02:00:48.072Z [INFO] instance pruned: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06dd8ad6fee429838 lifetime=20m43.191997036s
2023-12-10T02:00:42.660Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-05096ae3d934cfb44 state=deleting
2023-12-10T02:00:42.409Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge
2023-12-10T02:00:06.346Z [INFO] instance update: group=aws/eu-central-1/GitLabCiWorker-2xlarge id=i-06dd8ad6fee429838 state=deleting
2023-12-10T02:00:05.981Z [INFO] decreasing instances: amount=1 group=aws/eu-central-1/GitLabCiWorker-2xlarge## Environment description
Gitlab.com with private runners on AWS via fleeting plugin. Config is provided in steps to reproduce section
Used GitLab Runner version
Tested on 16.5 but it happens also on 16.6.1
Edited by Justin Farmiloe