Can't register an array of dns servers from a powershell variable

Summary

This is about the shared runner(s) we have setup and running in https://gitlab.freedesktop.org . Recently one of the runner disks died and we had to reprovision it. The full setup is listed below but the sort summary is, that our new runner can no longer run process isolation containers in gitlab-runner, but the docker cli works as expected.

PS C:\Users\Administrator\runner> docker run --rm --isolation=process mcr.microsoft.com/windows/servercore:ltsc2022 powershell
Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.

Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows

PS C:\>
PS C:\Users\Administrator\runner>

Relevant logs and/or screenshots

Gitlab Runner can no longer create Windows containers with process isolation. Instead it fails with:

Running with gitlab-runner 16.6.1 (f5da3c5a)
  on WIN-M9O8VUVFMMT 8gDxV7Ep9, system ID: s_6530b07aab10
Preparing the "docker-windows" executor 00:00
Using Docker executor with image mcr.microsoft.com/windows/servercore:ltsc2022 ...
WARNING: Container based cache volumes creation is disabled. Will not create volume for "c:\\cache"
Pulling docker image mcr.microsoft.com/windows/servercore:ltsc2022 ...
Using docker image sha256:554d252c1f0f4c6b23c28f91e6966e39eb7dd4dd98895ef63404746ea8c8eb96 for mcr.microsoft.com/windows/servercore:ltsc2022 with digest mcr.microsoft.com/windows/servercore@sha256:029d8eb737c978e3df0f26abb529efd38d3c9ecee9d8d0bba6d0c205f32dc263 ...
Preparing environment 00:01
ERROR: Job failed (system failure): prepare environment: Error response from daemon: hcs::CreateComputeSystem ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320: The parameter is incorrect. (exec.go:78:0s). Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information

https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123/-/jobs/52719960

The error seems to come from here: https://gitlab.com/gitlab-org/gitlab-runner/-/blob/9e84d2b2767c905a53e9ab2329dde4cc1802b748/executors/docker/internal/exec/exec.go#L77-81

gitlab-runner --debug run logs

Using Docker executor with image mcr.microsoft.com/windows/servercore:ltsc2022 ...  job=52719960 project=1525 runner=8gDxV7Ep9
Creating user-defined volumes...                    job=52719960 project=1525 runner=8gDxV7Ep9
Cache containers feature is disabled                job=52719960 project=1525 runner=8gDxV7Ep9
WARNING: Container based cache volumes creation is disabled. Will not create volume for "c:\\cache"  job=52719960 project=1525 runner=8gDxV7Ep9
Creating build volume...                            job=52719960 project=1525 runner=8gDxV7Ep9
Cache containers feature is disabled                job=52719960 project=1525 runner=8gDxV7Ep9
Using host-based "runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7" for "C:/Users/Administrator/runner/builds"...  job=52719960 project=1525 runner=8gDxV7Ep9
Using volume "runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7" as cache "C:/Users/Administrator/runner/builds"...  job=52719960 project=1525 runner=8gDxV7Ep9
Creating services...                                job=52719960 project=1525 runner=8gDxV7Ep9
Building service links...                           job=52719960 project=1525 runner=8gDxV7Ep9
Starting Docker command...                          job=52719960 project=1525 runner=8gDxV7Ep9
Looking for prebuilt image registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a-servercore21H2...  job=52719960 project=1525 runner=8gDxV7Ep9
Looking for image mcr.microsoft.com/windows/servercore:ltsc2022 ...  job=52719960 project=1525 runner=8gDxV7Ep9
No credentials found for mcr.microsoft.com/windows/servercore:ltsc2022  job=52719960 project=1525 runner=8gDxV7Ep9
Pulling docker image mcr.microsoft.com/windows/servercore:ltsc2022 ...  job=52719960 project=1525 runner=8gDxV7Ep9
Checking for jobs...no content                      runner=8gDxV7Ep9 status=204 No Content
Using docker image sha256:554d252c1f0f4c6b23c28f91e6966e39eb7dd4dd98895ef63404746ea8c8eb96 for mcr.microsoft.com/windows/servercore:ltsc2022 with digest mcr.microsoft.com/windows/servercore@sha256:029d8eb737c978e3df0f26abb529efd38d3c9ecee9d8d0bba6d0c205f32dc263 ...  job=52719960 project=1525 runner=8gDxV7Ep9
Waiting for signals...                              job=52719960 project=1525 runner=8gDxV7Ep9
No referees configured                              job=52719960 project=1525 runner=8gDxV7Ep9
Executing build stage                               build_stage=prepare_script job=52719960 project=1525 runner=8gDxV7Ep9
Preparing environment                   job=52719960 project=1525 runner=8gDxV7Ep9
Looking for prebuilt image registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a-servercore21H2...  job=52719960 project=1525 runner=8gDxV7Ep9
Looking for image sha256:41bf01688ded8a52672ad8d438c8fadc600c306b19da34ddd17655d69e97202d ...  job=52719960 project=1525 runner=8gDxV7Ep9
Removing container runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined  job=52719960 project=1525 runner=8gDxV7Ep9
Disconnecting container runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined from networks  job=52719960 project=1525 runner=8gDxV7Ep9
Removing container runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined finished with error Error response from daemon: No such container: runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined (docker.go:744:0s)  job=52719960 project=1525 runner=8gDxV7Ep9
Creating container runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined ...  job=52719960 project=1525 runner=8gDxV7Ep9
Executing on /runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined the & {

echo "Running on $([Environment]::MachineName) via "WIN-M9O8VUVFMMT"..."

}

  job=52719960 project=1525 runner=8gDxV7Ep9
Attaching to container ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 ...  job=52719960 project=1525 runner=8gDxV7Ep9
Starting container ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 ...  job=52719960 project=1525 runner=8gDxV7Ep9
Removing container ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320  job=52719960 project=1525 runner=8gDxV7Ep9
Disconnecting container ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 from networks  job=52719960 project=1525 runner=8gDxV7Ep9
Removed container ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320  job=52719960 project=1525 runner=8gDxV7Ep9
ERROR: Job failed (system failure): prepare environment: Error response from daemon: hcs::CreateComputeSystem ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320: The parameter is incorrect. (exec.go:78:0s). Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information  duration_s=0.9187676 job=52719960 project=1525 runner=8gDxV7Ep9
Appending trace to coordinator...ok                 code=202 job=52719960 job-log=0-1291 job-status=running runner=8gDxV7Ep9 sent-log=0-1290 status=202 Accepted update-interval=1m0s
Updating job...                                     bytesize=1291 checksum=crc32:4d934e44 job=52719960 runner=8gDxV7Ep9
Submitting job to coordinator...accepted, but not yet completed  bytesize=1291 checksum=crc32:4d934e44 code=202 job=52719960 job-status= runner=8gDxV7Ep9 update-interval=1s
Updating job...                                     bytesize=1291 checksum=crc32:4d934e44 job=52719960 runner=8gDxV7Ep9
Submitting job to coordinator...ok                  bytesize=1291 checksum=crc32:4d934e44 code=200 job=52719960 job-status= runner=8gDxV7Ep9 update-interval=0s
Removed job from processing list                    builds=0 job=52719960 max_builds=4 project=1525 repo_url=https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123.git
WARNING: Failed to process runner                   builds=0 error=prepare environment: Error response from daemon: hcs::CreateComputeSystem ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320: The parameter is incorrect. (exec.go:78:0s). Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information executor=docker-windows max_builds=4 runner=8gDxV7Ep9
Feeding runner to channel                           builds=0 max_builds=4 runner=s5pujaoqM
Processing runner                                   builds=0 max_builds=4 runner=s5pujaoqM
Acquiring executor from provider                    builds=0 max_builds=4 runner=s5pujaoqM

The dockerd logs are below

dockerd_logs.txt

time="2023-12-13T09:35:42.903884800-08:00" level=info msg="API listen on //./pipe/docker_engine"
time="2023-12-13T09:35:42.903884800-08:00" level=debug msg="Config reload - waiting signal at Global\\docker-daemon-config-1544"
time="2023-12-13T09:35:59.176298000-08:00" level=debug msg="Calling HEAD /_ping"
time="2023-12-13T09:35:59.177761600-08:00" level=debug msg="Calling GET /v1.43/info"
time="2023-12-13T09:35:59.188315200-08:00" level=debug msg="Calling POST /v1.43/volumes/create"
time="2023-12-13T09:35:59.188388700-08:00" level=debug msg="form data: {\"Labels\":{\"com.gitlab.gitlab-runner.job.before_sha\":\"634de0836ee193b13588c4622a9c699200eb9c23\",\"com.gitlab.gitlab-runner.job.id\":\"52719960\",\"com.gitlab.gitlab-runner.job.ref\":\"alatiera/windows-hello-world\",\"com.gitlab.gitlab-runner.job.sha\":\"006c4430799bb2057375c18c2022fdd7e6bddc1b\",\"com.gitlab.gitlab-runner.job.url\":\"https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123/-/jobs/52719960\",\"com.gitlab.gitlab-runner.managed\":\"true\",\"com.gitlab.gitlab-runner.pipeline.id\":\"1056187\",\"com.gitlab.gitlab-runner.project.id\":\"1525\",\"com.gitlab.gitlab-runner.runner.id\":\"8gDxV7Ep9\",\"com.gitlab.gitlab-runner.runner.local_id\":\"0\",\"com.gitlab.gitlab-runner.type\":\"cache\"},\"Name\":\"runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7\"}"
time="2023-12-13T09:35:59.188976300-08:00" level=debug msg="using regular volume"
time="2023-12-13T09:35:59.189194500-08:00" level=debug msg="Probing all drivers for volume with name: runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7"
time="2023-12-13T09:35:59.190128600-08:00" level=debug msg="Registering new volume reference: driver \"local\", name \"runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7\""
time="2023-12-13T09:35:59.219630200-08:00" level=debug msg="Calling GET /v1.43/images/registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a-servercore21H2/json"
time="2023-12-13T09:35:59.224912100-08:00" level=debug msg="Calling GET /v1.43/images/mcr.microsoft.com/windows/servercore:ltsc2022/json"
time="2023-12-13T09:35:59.230660000-08:00" level=debug msg="Calling POST /v1.43/images/create?fromImage=mcr.microsoft.com%2Fwindows%2Fservercore&tag=ltsc2022"
time="2023-12-13T09:35:59.238609000-08:00" level=debug msg="hostDir: C:\\ProgramData\\docker\\certs.d\\mcr.microsoft.com"
time="2023-12-13T09:35:59.239127500-08:00" level=debug msg="Trying to pull mcr.microsoft.com/windows/servercore from https://mcr.microsoft.com"
time="2023-12-13T09:35:59.552915100-08:00" level=debug msg="Pulling ref from V2 registry: mcr.microsoft.com/windows/servercore:ltsc2022"
time="2023-12-13T09:35:59.553438300-08:00" level=debug msg="mcr.microsoft.com/windows/servercore:ltsc2022 resolved to a manifestList object with 1 entries; looking for a unknown match"
time="2023-12-13T09:35:59.555065700-08:00" level=debug msg="will prefer Windows entries with version 10.0.20348"
time="2023-12-13T09:35:59.555596900-08:00" level=debug msg="found match windows/amd64 10.0.20348.2159 with media type application/vnd.docker.distribution.manifest.v2+json, digest sha256:2fd5f6c3c468969e78a1fbd9b96d4fb8db873d57abfefa3d565230fd5580cd45"
time="2023-12-13T09:35:59.560665300-08:00" level=debug msg="Adding content digest to lease" digest="sha256:029d8eb737c978e3df0f26abb529efd38d3c9ecee9d8d0bba6d0c205f32dc263" lease="moby-image-sha256:554d252c1f0f4c6b23c28f91e6966e39eb7dd4dd98895ef63404746ea8c8eb96" remote="mcr.microsoft.com/windows/servercore:ltsc2022"
time="2023-12-13T09:35:59.562883300-08:00" level=debug msg="Adding content digest to lease" digest="sha256:2fd5f6c3c468969e78a1fbd9b96d4fb8db873d57abfefa3d565230fd5580cd45" lease="moby-image-sha256:554d252c1f0f4c6b23c28f91e6966e39eb7dd4dd98895ef63404746ea8c8eb96" remote="mcr.microsoft.com/windows/servercore:ltsc2022"
time="2023-12-13T09:35:59.568961900-08:00" level=debug msg="Calling GET /v1.43/images/mcr.microsoft.com/windows/servercore:ltsc2022/json"
time="2023-12-13T09:35:59.575593500-08:00" level=debug msg="Calling GET /v1.43/images/registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-f5da3c5a-servercore21H2/json"
time="2023-12-13T09:35:59.578280600-08:00" level=debug msg="Calling GET /v1.43/images/sha256:41bf01688ded8a52672ad8d438c8fadc600c306b19da34ddd17655d69e97202d/json"
time="2023-12-13T09:35:59.583612300-08:00" level=debug msg="Calling GET /v1.43/networks"
time="2023-12-13T09:35:59.585505000-08:00" level=debug msg="Calling DELETE /v1.43/containers/runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined?force=1&v=1"
time="2023-12-13T09:35:59.587375800-08:00" level=debug msg="Calling POST /v1.43/containers/create?name=runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined"
time="2023-12-13T09:35:59.591012700-08:00" level=debug msg="Calling proc (1)" spanID=872bbc660e5edb0e traceID=07591efbbb8e671f3fd72b9604f43489
time="2023-12-13T09:35:59.591012700-08:00" level=debug msg="Calling proc (2)" spanID=872bbc660e5edb0e traceID=07591efbbb8e671f3fd72b9604f43489
time="2023-12-13T09:35:59.689754700-08:00" level=debug msg="Calling GET /v1.43/containers/ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320/json"
time="2023-12-13T09:35:59.697197100-08:00" level=debug msg="Calling POST /v1.43/containers/ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320/attach?stderr=1&stdin=1&stdout=1&stream=1"
time="2023-12-13T09:35:59.697760200-08:00" level=debug msg="attach: stdin: begin"
time="2023-12-13T09:35:59.698564000-08:00" level=debug msg="attach: stdout: begin"
time="2023-12-13T09:35:59.698564000-08:00" level=debug msg="attach: stderr: begin"
time="2023-12-13T09:35:59.700442600-08:00" level=debug msg="Calling POST /v1.43/containers/ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320/start"
time="2023-12-13T09:35:59.700442600-08:00" level=debug msg="WindowsGraphDriver Get() id ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 mountLabel "
time="2023-12-13T09:35:59.730396000-08:00" level=debug msg="Calling proc (1)" spanID=2c129e4a056edb24 traceID=4639d62c8c174a77644fd823937ed777
time="2023-12-13T09:35:59.730396000-08:00" level=debug msg="Calling proc (2)" spanID=2c129e4a056edb24 traceID=4639d62c8c174a77644fd823937ed777
time="2023-12-13T09:35:59.731490400-08:00" level=debug msg="container mounted via layerStore: \\\\?\\Volume{f4a54e7f-1f50-42dd-b0a9-5491c9d6431c}" container=ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320
time="2023-12-13T09:35:59.732055200-08:00" level=debug msg="Assigning addresses for endpoint runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined's interface on network nat"
time="2023-12-13T09:35:59.732055200-08:00" level=debug msg="RequestAddress(172.24.96.0/20, <nil>, map[])"
time="2023-12-13T09:35:59.732572700-08:00" level=debug msg="endpointStruct.EnableInternalDNS =[true]"
time="2023-12-13T09:35:59.732572700-08:00" level=debug msg="[POST]=>[/endpoints/] Request : {\"VirtualNetwork\":\"3AFD1EF0-5188-4597-BC61-36C34F81A176\",\"DNSServerList\":\"[1.1.1.1, 8.8.8.8]\",\"EnableInternalDNS\":true}"
time="2023-12-13T09:35:59.737114000-08:00" level=debug msg="Network Response : {\"ID\":\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\",\"Name\":\"Ethernet\",\"Version\":55834574851,\"AdditionalParams\":{},\"Resources\":{\"AdditionalParams\":{},\"AllocationOrder\":0,\"CompartmentOperationTime\":0,\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625597356736},\"ID\":\"88D8C3E1-404B-4ADF-93CF-03CFAB02B838\",\"PortOperationTime\":0,\"State\":1,\"SwitchOperationTime\":0,\"VfpOperationTime\":0,\"parentId\":\"74FD4692-9F5B-4263-B71F-84D8EF70C68F\"},\"State\":1,\"VirtualNetwork\":\"3afd1ef0-5188-4597-bc61-36c34f81a176\",\"VirtualNetworkName\":\"nat\",\"MacAddress\":\"00-15-5D-DC-70-C9\",\"EnableInternalDNS\":true,\"IPAddress\":\"172.24.96.133\",\"PrefixLength\":20,\"GatewayAddress\":\"172.24.96.1\",\"IPSubnetId\":\"de42282e-f680-4fcb-a8b7-3ad303c6cb55\",\"DNSServerList\":\"172.24.96.1,[1.1.1.1, 8.8.8.8]\",\"SharedContainers\":[]}"
time="2023-12-13T09:35:59.740212600-08:00" level=debug msg="Assigning addresses for endpoint runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined's interface on network nat"
time="2023-12-13T09:35:59.740931400-08:00" level=debug msg="7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269 (ef24ae8).addSvcRecords(runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined, 172.24.96.133, <nil>, true) updateSvcRecord sid:7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269"
time="2023-12-13T09:35:59.744284000-08:00" level=debug msg="[GET]=>[/endpoints/b47d71f1-f086-4da3-a79f-04e1a84c94bc] Request : "
time="2023-12-13T09:35:59.745954300-08:00" level=debug msg="Network Response : {\"ID\":\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\",\"Name\":\"Ethernet\",\"Version\":55834574851,\"AdditionalParams\":{},\"Resources\":{\"AdditionalParams\":{},\"AllocationOrder\":0,\"CompartmentOperationTime\":0,\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625597356736},\"ID\":\"88D8C3E1-404B-4ADF-93CF-03CFAB02B838\",\"PortOperationTime\":0,\"State\":1,\"SwitchOperationTime\":0,\"VfpOperationTime\":0,\"parentId\":\"74FD4692-9F5B-4263-B71F-84D8EF70C68F\"},\"State\":1,\"VirtualNetwork\":\"3afd1ef0-5188-4597-bc61-36c34f81a176\",\"VirtualNetworkName\":\"nat\",\"MacAddress\":\"00-15-5D-DC-70-C9\",\"EnableInternalDNS\":true,\"IPAddress\":\"172.24.96.133\",\"PrefixLength\":20,\"GatewayAddress\":\"172.24.96.1\",\"IPSubnetId\":\"de42282e-f680-4fcb-a8b7-3ad303c6cb55\",\"DNSServerList\":\"172.24.96.1,[1.1.1.1, 8.8.8.8]\",\"SharedContainers\":[]}"
time="2023-12-13T09:35:59.746470000-08:00" level=debug msg="[GET]=>[/endpoints/b47d71f1-f086-4da3-a79f-04e1a84c94bc] Request : "
time="2023-12-13T09:35:59.748277800-08:00" level=debug msg="Network Response : {\"ID\":\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\",\"Name\":\"Ethernet\",\"Version\":55834574851,\"AdditionalParams\":{},\"Resources\":{\"AdditionalParams\":{},\"AllocationOrder\":0,\"CompartmentOperationTime\":0,\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625597356736},\"ID\":\"88D8C3E1-404B-4ADF-93CF-03CFAB02B838\",\"PortOperationTime\":0,\"State\":1,\"SwitchOperationTime\":0,\"VfpOperationTime\":0,\"parentId\":\"74FD4692-9F5B-4263-B71F-84D8EF70C68F\"},\"State\":1,\"VirtualNetwork\":\"3afd1ef0-5188-4597-bc61-36c34f81a176\",\"VirtualNetworkName\":\"nat\",\"MacAddress\":\"00-15-5D-DC-70-C9\",\"EnableInternalDNS\":true,\"IPAddress\":\"172.24.96.133\",\"PrefixLength\":20,\"GatewayAddress\":\"172.24.96.1\",\"IPSubnetId\":\"de42282e-f680-4fcb-a8b7-3ad303c6cb55\",\"DNSServerList\":\"172.24.96.1,[1.1.1.1, 8.8.8.8]\",\"SharedContainers\":[]}"
time="2023-12-13T09:35:59.749989500-08:00" level=debug msg="7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269 (ef24ae8).addSvcRecords(runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined, 172.24.96.133, <nil>, true) updateSvcRecord sid:7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269"
time="2023-12-13T09:35:59.751728900-08:00" level=debug msg="Programming external connectivity on endpoint runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined (7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269)"
time="2023-12-13T09:35:59.751728900-08:00" level=debug msg="EnableService ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 START"
time="2023-12-13T09:35:59.751728900-08:00" level=debug msg="EnableService ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320 DONE"
time="2023-12-13T09:35:59.757405300-08:00" level=debug msg="Generated spec: {\"ociVersion\":\"1.1.0-rc.2\",\"process\":{\"user\":{\"uid\":0,\"gid\":0,\"username\":\"ContainerAdministrator\"},\"args\":[\"entrypoint.cmd\",\"powershell\",\"-NoProfile\",\"-NoLogo\",\"-InputFormat\",\"text\",\"-OutputFormat\",\"text\",\"-NonInteractive\",\"-ExecutionPolicy\",\"Bypass\",\"-Command\",\"-\"],\"env\":[\"FF_CMD_DISABLE_DELAYED_ERROR_LEVEL_EXPANSION=false\",\"FF_NETWORK_PER_BUILD=false\",\"FF_USE_LEGACY_KUBERNETES_EXECUTION_STRATEGY=false\",\"FF_USE_DIRECT_DOWNLOAD=true\",\"FF_SKIP_NOOP_BUILD_STAGES=true\",\"FF_USE_FASTZIP=false\",\"FF_DISABLE_UMASK_FOR_DOCKER_EXECUTOR=false\",\"FF_ENABLE_BASH_EXIT_CODE_CHECK=false\",\"FF_USE_WINDOWS_LEGACY_PROCESS_STRATEGY=true\",\"FF_USE_NEW_BASH_EVAL_STRATEGY=false\",\"FF_USE_POWERSHELL_PATH_RESOLVER=false\",\"FF_USE_DYNAMIC_TRACE_FORCE_SEND_INTERVAL=false\",\"FF_SCRIPT_SECTIONS=false\",\"FF_USE_NEW_SHELL_ESCAPE=false\",\"FF_ENABLE_JOB_CLEANUP=false\",\"FF_KUBERNETES_HONOR_ENTRYPOINT=false\",\"FF_POSIXLY_CORRECT_ESCAPES=false\",\"FF_USE_IMPROVED_URL_MASKING=false\",\"FF_RESOLVE_FULL_TLS_CHAIN=false\",\"FF_DISABLE_POWERSHELL_STDIN=false\",\"FF_USE_POD_ACTIVE_DEADLINE_SECONDS=true\",\"FF_USE_ADVANCED_POD_SPEC_CONFIGURATION=false\",\"FF_SET_PERMISSIONS_BEFORE_CLEANUP=true\",\"FF_SECRET_RESOLVING_FAILS_IF_MISSING=true\",\"FF_RETRIEVE_POD_WARNING_EVENTS=false\",\"FF_PRINT_POD_EVENTS=false\",\"FF_USE_GIT_BUNDLE_URIS=true\",\"FF_USE_DUMB_INIT_WITH_KUBERNETES_EXECUTOR=false\",\"FF_USE_INIT_WITH_DOCKER_EXECUTOR=false\",\"CI_JOB_IMAGE=mcr.microsoft.com/windows/servercore:ltsc2022\",\"CI_RUNNER_SHORT_TOKEN=8gDxV7Ep9\",\"FDO_CI_CONCURRENT=16\",\"CI_BUILDS_DIR=C:\\\\Users\\\\Administrator\\\\runner\\\\builds\",\"CI_PROJECT_DIR=C:\\\\Users\\\\Administrator\\\\runner\\\\builds\\\\alatiera\\\\gstreamer_test_test123\",\"CI_CONCURRENT_ID=0\",\"CI_CONCURRENT_PROJECT_ID=0\",\"CI_SERVER=yes\",\"CI_JOB_STATUS=running\",\"CI_JOB_TIMEOUT=3600\",\"CI_SERVER_TLS_CA_FILE=C:/Users/Administrator/runner/builds/alatiera/gstreamer_test_test123.tmp/CI_SERVER_TLS_CA_FILE\",\"CI_PIPELINE_ID=1056187\",\"CI_PIPELINE_URL=https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123/-/pipelines/1056187\",\"CI_JOB_ID=52719960\",\"CI_JOB_URL=https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123/-/jobs/52719960\",\"CI_JOB_TOKEN=64_zgq_b-ChGMRUYz2m6ysV\",\"CI_JOB_STARTED_AT=2023-12-13T17:35:58Z\",\"CI_REGISTRY_USER=gitlab-ci-token\",\"CI_REGISTRY_PASSWORD=64_zgq_b-ChGMRUYz2m6ysV\",\"CI_REPOSITORY_URL=https://gitlab-ci-token:64_zgq_b-ChGMRUYz2m6ysV@gitlab.freedesktop.org/alatiera/gstreamer_test_test123.git\",\"CI_JOB_JWT=eyJraWQiOiJNa2RNUzhxSWloLXJGM2o2V3pJM3U2Tzl6dGh4bnlKVmFDUXkxUjQ0Y0drIiwidHlwIjoiSldUIiwiYWxnIjoiUlMyNTYifQ.eyJuYW1lc3BhY2VfaWQiOiIyNzc2IiwibmFtZXNwYWNlX3BhdGgiOiJhbGF0aWVyYSIsInByb2plY3RfaWQiOiIxNTI1IiwicHJvamVjdF9wYXRoIjoiYWxhdGllcmEvZ3N0cmVhbWVyX3Rlc3RfdGVzdDEyMyIsInVzZXJfaWQiOiIyNTU0IiwidXNlcl9sb2dpbiI6ImFsYXRpZXJhIiwidXNlcl9lbWFpbCI6ImpwZXRyaWRpc0Bnbm9tZS5vcmciLCJwaXBlbGluZV9pZCI6IjEwNTYxODciLCJwaXBlbGluZV9zb3VyY2UiOiJwdXNoIiwiam9iX2lkIjoiNTI3MTk5NjAiLCJyZWYiOiJhbGF0aWVyYS93aW5kb3dzLWhlbGxvLXdvcmxkIiwicmVmX3R5cGUiOiJicmFuY2giLCJyZWZfcGF0aCI6InJlZnMvaGVhZHMvYWxhdGllcmEvd2luZG93cy1oZWxsby13b3JsZCIsInJlZl9wcm90ZWN0ZWQiOiJmYWxzZSIsImp0aSI6ImY5NGMxM2NkLTI4YzAtNGY3Yi1hMTlmLTQ2NDg0M2RiODhhNSIsImlzcyI6ImdpdGxhYi5mcmVlZGVza3RvcC5vcmciLCJpYXQiOjE3MDI0ODg5NTgsIm5iZiI6MTcwMjQ4ODk1MywiZXhwIjoxNzAyNDkyNTU4LCJzdWIiOiJqb2JfNTI3MTk5NjAifQ.T4Kmz3v-ItxZZXKLOkMwQYSsJxA-_RvLm3Bje8kVH1KOGaDAArE6dzQTD3U5QkHVQdM_7qKNiRvsWk51TExac3P5bnzazUaeD47Jfm8G71Q0H1pvv_SGpJbAtQkoC-06p-SOikeBsBmq7rIMiwwapzdUMgXQVb501hfNhbVuQK94ZuBamovAsFjSs-J1iQqmFH1oVSRdyx1vtn526lcR7uk6xO3bV2ARa4v6vYgba4RbKK75lnhY78lbZmJOeo7k9TJPI8mz7RHzwnged1OcZiRZbx6sSpRCosjciHdsfYevwS7lDe-9_3ihat_gH1Mc7ewfT3JqaFFUhtiPxh2Z3w\",\"CI_JOB_JWT_V1=eyJraWQiOiJNa2RNUzhxSWloLXJGM2o2V3pJM3U2Tzl6dGh4bnlKVmFDUXkxUjQ0Y0drIiwidHlwIjoiSldUIiwiYWxnIjoiUlMyNTYifQ.eyJuYW1lc3BhY2VfaWQiOiIyNzc2IiwibmFtZXNwYWNlX3BhdGgiOiJhbGF0aWVyYSIsInByb2plY3RfaWQiOiIxNTI1IiwicHJvamVjdF9wYXRoIjoiYWxhdGllcmEvZ3N0cmVhbWVyX3Rlc3RfdGVzdDEyMyIsInVzZXJfaWQiOiIyNTU0IiwidXNlcl9sb2dpbiI6ImFsYXRpZXJhIiwidXNlcl9lbWFpbCI6ImpwZXRyaWRpc0Bnbm9tZS5vcmciLCJwaXBlbGluZV9pZCI6IjEwNTYxODciLCJwaXBlbGluZV9zb3VyY2UiOiJwdXNoIiwiam9iX2lkIjoiNTI3MTk5NjAiLCJyZWYiOiJhbGF0aWVyYS93aW5kb3dzLWhlbGxvLXdvcmxkIiwicmVmX3R5cGUiOiJicmFuY2giLCJyZWZfcGF0aCI6InJlZnMvaGVhZHMvYWxhdGllcmEvd2luZG93cy1oZWxsby13b3JsZCIsInJlZl9wcm90ZWN0ZWQiOiJmYWxzZSIsImp0aSI6ImY5NGMxM2NkLTI4YzAtNGY3Yi1hMTlmLTQ2NDg0M2RiODhhNSIsImlzcyI6ImdpdGxhYi5mcmVlZGVza3RvcC5vcmciLCJpYXQiOjE3MDI0ODg5NTgsIm5iZiI6MTcwMjQ4ODk1MywiZXhwIjoxNzAyNDkyNTU4LCJzdWIiOiJqb2JfNTI3MTk5NjAifQ.T4Kmz3v-ItxZZXKLOkMwQYSsJxA-_RvLm3Bje8kVH1KOGaDAArE6dzQTD3U5QkHVQdM_7qKNiRvsWk51TExac3P5bnzazUaeD47Jfm8G71Q0H1pvv_SGpJbAtQkoC-06p-SOikeBsBmq7rIMiwwapzdUMgXQVb501hfNhbVuQK94ZuBamovAsFjSs-J1iQqmFH1oVSRdyx1vtn526lcR7uk6xO3bV2ARa4v6vYgba4RbKK75lnhY78lbZmJOeo7k9TJPI8mz7RHzwnged1OcZiRZbx6sSpRCosjciHdsfYevwS7lDe-9_3ihat_gH1Mc7ewfT3JqaFFUhtiPxh2Z3w\",\"CI_JOB_JWT_V2=eyJraWQiOiJNa2RNUzhxSWloLXJGM2o2V3pJM3U2Tzl6dGh4bnlKVmFDUXkxUjQ0Y0drIiwidHlwIjoiSldUIiwiYWxnIjoiUlMyNTYifQ.eyJuYW1lc3BhY2VfaWQiOiIyNzc2IiwibmFtZXNwYWNlX3BhdGgiOiJhbGF0aWVyYSIsInByb2plY3RfaWQiOiIxNTI1IiwicHJvamVjdF9wYXRoIjoiYWxhdGllcmEvZ3N0cmVhbWVyX3Rlc3RfdGVzdDEyMyIsInVzZXJfaWQiOiIyNTU0IiwidXNlcl9sb2dpbiI6ImFsYXRpZXJhIiwidXNlcl9lbWFpbCI6ImpwZXRyaWRpc0Bnbm9tZS5vcmciLCJwaXBlbGluZV9pZCI6IjEwNTYxODciLCJwaXBlbGluZV9zb3VyY2UiOiJwdXNoIiwiam9iX2lkIjoiNTI3MTk5NjAiLCJyZWYiOiJhbGF0aWVyYS93aW5kb3dzLWhlbGxvLXdvcmxkIiwicmVmX3R5cGUiOiJicmFuY2giLCJyZWZfcGF0aCI6InJlZnMvaGVhZHMvYWxhdGllcmEvd2luZG93cy1oZWxsby13b3JsZCIsInJlZl9wcm90ZWN0ZWQiOiJmYWxzZSIsInJ1bm5lcl9pZCI6MzY0MywicnVubmVyX2Vudmlyb25tZW50Ijoic2VsZi1ob3N0ZWQiLCJzaGEiOiIwMDZjNDQzMDc5OWJiMjA1NzM3NWMxOGMyMDIyZmRkN2U2YmRkYzFiIiwicHJvamVjdF92aXNpYmlsaXR5IjoicHVibGljIiwiY2lfY29uZmlnX3JlZl91cmkiOiJnaXRsYWIuZnJlZWRlc2t0b3Aub3JnL2FsYXRpZXJhL2dzdHJlYW1lcl90ZXN0X3Rlc3QxMjMvLy5naXRsYWItY2kueW1sQHJlZnMvaGVhZHMvYWxhdGllcmEvd2luZG93cy1oZWxsby13b3JsZCIsImNpX2NvbmZpZ19zaGEiOiIwMDZjNDQzMDc5OWJiMjA1NzM3NWMxOGMyMDIyZmRkN2U2YmRkYzFiIiwianRpIjoiZjVmYzhjOTMtYWRjNy00NDUxLTgyMzctZDI1MTc2ZTM3ZDVmIiwiaXNzIjoiaHR0cHM6Ly9naXRsYWIuZnJlZWRlc2t0b3Aub3JnIiwiaWF0IjoxNzAyNDg4OTU4LCJuYmYiOjE3MDI0ODg5NTMsImV4cCI6MTcwMjQ5MjU1OCwic3ViIjoicHJvamVjdF9wYXRoOmFsYXRpZXJhL2dzdHJlYW1lcl90ZXN0X3Rlc3QxMjM6cmVmX3R5cGU6YnJhbmNoOnJlZjphbGF0aWVyYS93aW5kb3dzLWhlbGxvLXdvcmxkIiwiYXVkIjoiaHR0cHM6Ly9naXRsYWIuZnJlZWRlc2t0b3Aub3JnIn0.U339O1pU-y1cxsw10uobDXKrrhLBBbTnYJRswrFjHstNXMsxnoQHqDIBFl3qOQ9SfuTMW-faJNntFl8cJcPI5GzvBvINXTaRlPnZinWqcLRc2mfWC8PUvAtewrPTHRJ2skC1MXL-uDsmjuK8gIOiUMN7kNgM-Wc6KsYdswMaZtGd8oHPbrqIfHMmi-9PHkSpnK-Yp7ZyZmDD-oqCO2k_wQ6jkCsnszogJobr5wBerzGUAtVLFjsNJLs05M9vh0--ye9egFBNxLA4GNzNu3ZLl9sZw7DTSxTdBChQvM74tnySkdxvYAf1uVedNJkeWukZSKgoUif7x3Uy8Va2wOYI7w\",\"CI_JOB_NAME=windows hello world\",\"CI_JOB_NAME_SLUG=windows-hello-world\",\"CI_JOB_STAGE=preparation\",\"CI_NODE_TOTAL=1\",\"CI=true\",\"GITLAB_CI=true\",\"CI_SERVER_URL=https://gitlab.freedesktop.org\",\"CI_SERVER_HOST=gitlab.freedesktop.org\",\"CI_SERVER_PORT=443\",\"CI_SERVER_PROTOCOL=https\",\"CI_SERVER_SHELL_SSH_HOST=gitlab.freedesktop.org\",\"CI_SERVER_SHELL_SSH_PORT=22\",\"CI_SERVER_NAME=GitLab\",\"CI_SERVER_VERSION=16.6.1\",\"CI_SERVER_VERSION_MAJOR=16\",\"CI_SERVER_VERSION_MINOR=6\",\"CI_SERVER_VERSION_PATCH=1\",\"CI_SERVER_REVISION=21d8cc00343\",\"GITLAB_FEATURES=\",\"CI_PROJECT_ID=1525\",\"CI_PROJECT_NAME=gstreamer_test_test123\",\"CI_PROJECT_TITLE=gstreamer_test_test123\",\"CI_PROJECT_DESCRIPTION=GStreamer open-source multimedia framework core library\",\"CI_PROJECT_PATH=alatiera/gstreamer_test_test123\",\"CI_PROJECT_PATH_SLUG=alatiera-gstreamer-test-test123\",\"CI_PROJECT_NAMESPACE=alatiera\",\"CI_PROJECT_NAMESPACE_ID=2776\",\"CI_PROJECT_ROOT_NAMESPACE=alatiera\",\"CI_PROJECT_URL=https://gitlab.freedesktop.org/alatiera/gstreamer_test_test123\",\"CI_PROJECT_VISIBILITY=public\",\"CI_PROJECT_REPOSITORY_LANGUAGES=c,c++,c#,python,meson\",\"CI_PROJECT_CLASSIFICATION_LABEL=\",\"CI_DEFAULT_BRANCH=main\",\"CI_CONFIG_PATH=.gitlab-ci.yml\",\"CI_PAGES_DOMAIN=pages.freedesktop.org\",\"CI_PAGES_URL=https://alatiera.pages.freedesktop.org/gstreamer_test_test123\",\"CI_REGISTRY=registry.freedesktop.org\",\"CI_REGISTRY_IMAGE=registry.freedesktop.org/alatiera/gstreamer_test_test123\",\"CI_API_V4_URL=https://gitlab.freedesktop.org/api/v4\",\"CI_API_GRAPHQL_URL=https://gitlab.freedesktop.org/api/graphql\",\"CI_TEMPLATE_REGISTRY_HOST=registry.gitlab.com\",\"CI_PIPELINE_IID=1023\",\"CI_PIPELINE_SOURCE=push\",\"CI_PIPELINE_CREATED_AT=2023-12-13T16:04:19Z\",\"CI_PIPELINE_NAME=\",\"CI_COMMIT_SHA=006c4430799bb2057375c18c2022fdd7e6bddc1b\",\"CI_COMMIT_SHORT_SHA=006c4430\",\"CI_COMMIT_BEFORE_SHA=634de0836ee193b13588c4622a9c699200eb9c23\",\"CI_COMMIT_REF_NAME=alatiera/windows-hello-world\",\"CI_COMMIT_REF_SLUG=alatiera-windows-hello-world\",\"CI_COMMIT_BRANCH=alatiera/windows-hello-world\",\"CI_COMMIT_MESSAGE=fixup! windows hello world\\n\",\"CI_COMMIT_TITLE=fixup! windows hello world\",\"CI_COMMIT_DESCRIPTION=\",\"CI_COMMIT_REF_PROTECTED=false\",\"CI_COMMIT_TIMESTAMP=2023-12-13T18:04:06+02:00\",\"CI_COMMIT_AUTHOR=Jordan Petridis \\u003cjordan@centricular.com\\u003e\",\"CI_RUNNER_ID=3643\",\"CI_RUNNER_DESCRIPTION=test-docker-2\",\"CI_RUNNER_TAGS=[\\\"docker\\\", \\\"windows\\\", \\\"mesa\\\", \\\"gstreamer-windows\\\", \\\"2022\\\"]\",\"GIT_FETCH_EXTRA_FLAGS=--no-tags\",\"FEDORA_TAG=2023-11-16.0\",\"INDENT_TAG=2023-08-24.3\",\"LINT_TAG=2023-02-16.5\",\"WINDOWS_TAG=2023-11-16.0\",\"GIT_DEPTH=1\",\"GST_UPSTREAM_BRANCH=main\",\"FDO_UPSTREAM_REPO=gstreamer/gstreamer\",\"MESON_COMMIT=\",\"FEDORA_AMD64_SUFFIX=amd64/fedora\",\"INDENT_AMD64_SUFFIX=amd64/gst-indent\",\"COMMITLINT_AMD64_SUFFIX=amd64/commitlint\",\"WINDOWS_AMD64_SUFFIX=amd64/windows\",\"WINDOWS_IMAGE=registry.freedesktop.org/alatiera/gstreamer_test_test123/amd64/windows:2023-11-16.0-main\",\"WINDOWS_UPSTREAM_IMAGE=registry.freedesktop.org/gstreamer/gstreamer/amd64/windows:2023-11-16.0-main\",\"DEFAULT_MESON_ARGS=-Dlibnice:tests=disabled -Dlibnice:examples=disabled -Dlibnice:gupnp=disabled -Dopenh264:tests=disabled -Dpygobject:tests=false -Dpython=enabled -Dlibav=enabled -Dugly=enabled -Dbad=enabled -Ddevtools=enabled -Dges=enabled -Drtsp_server=enabled -Dvaapi=enabled -Dsharp=disabled -Drs=disabled -Dgpl=enabled -Dintrospection=enabled\",\"SIMPLE_BUILD=-Dlibnice:tests=disabled -Dlibnice:examples=disabled -Dlibnice:gupnp=disabled -Dopenh264:tests=disabled -Dpygobject:tests=false -Dpython=enabled -Dlibav=enabled -Dugly=enabled -Dbad=enabled -Ddevtools=enabled -Dges=enabled -Drtsp_server=enabled -Dvaapi=enabled -Dsharp=disabled -Drs=disabled -Dgpl=enabled -Dintrospection=enabled -Dsharp=enabled -Ddoc=disabled\",\"GITLAB_USER_ID=2554\",\"GITLAB_USER_EMAIL=jpetridis@gnome.org\",\"GITLAB_USER_LOGIN=alatiera\",\"GITLAB_USER_NAME=Jordan Petridіs\",\"CI_GATING_TOKEN=C:/Users/Administrator/runner/builds/alatiera/gstreamer_test_test123.tmp/CI_GATING_TOKEN\",\"CI_DISPOSABLE_ENVIRONMENT=true\",\"CI_RUNNER_VERSION=16.6.1\",\"CI_RUNNER_REVISION=f5da3c5a\",\"CI_RUNNER_EXECUTABLE_ARCH=windows/amd64\",\"RUNNER_TEMP_PROJECT_DIR=C:/Users/Administrator/runner/builds/alatiera/gstreamer_test_test123.tmp\"],\"cwd\":\"C:\\\\\"},\"root\":{\"path\":\"\\\\\\\\?\\\\Volume{f4a54e7f-1f50-42dd-b0a9-5491c9d6431c}\\\\\"},\"hostname\":\"runner-8gdxv7ep9-project-1525-concurrent-0\",\"mounts\":[{\"destination\":\"c:\\\\users\\\\administrator\\\\runner\\\\builds\",\"source\":\"C:\\\\ProgramData\\\\docker\\\\volumes\\\\runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7\\\\_data\"}],\"windows\":{\"layerFolders\":[\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\1dd23d4efe950225b36b70cb2d0eaf02110cb7d8b9aa62a83d5897fa77ed89b5\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\a64444d1056d25bea75a124468ef391c6b98084c5161423fce986857a2009ab2\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\86b3df0512bd10dc0ff0a262299fff90fe2f7976adb0bdd0707dfbb986bfa7c8\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\abf4129d18a21946c83c81be1cc101beceafe11293744d5537af7cfac9446c28\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\42ca2aa424c2fcb7424b3f3b083657b0254c738ee4d0e14ef22ca359a9e26ace\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\ebc67637ffb7309f4f9a143e9c9381dad97b57582ab376fa5acc475687166eda\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\2eee4a76df5e9d3ca3b598ce1c024621007b7f2c0bef9713d7ed8eeee12322e4\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\0f1851a8aa2994c9af413d21502389074b3cfda2a654edbb2d5875a5056e1434\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\ec27567f4b9f46b45b939c38a5975f6290849d509b56ac4697171c8b565877ae\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\45bb406d3dac6dedc45b5748a373ac1dddd23c4245a3ad6e308f8233a65bd0f6\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\f759544e309231a8fc2b4909957824b99f37fc9162a89e12d0d264070ccb9bd2\",\"C:\\\\ProgramData\\\\docker\\\\windowsfilter\\\\ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320\"],\"ignoreFlushesDuringBoot\":true,\"network\":{\"endpointList\":[\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\"],\"allowUnqualifiedDNSQuery\":true}}}"
time="2023-12-13T09:35:59.959564400-08:00" level=debug msg="HCS notification" notification-type=SystemCreateCompleted system-id=ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320
time="2023-12-13T09:35:59.969375000-08:00" level=debug msg="attach: stdout: end"
time="2023-12-13T09:35:59.969937100-08:00" level=debug msg="Revoking external connectivity on endpoint runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined (7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269)"
time="2023-12-13T09:35:59.970266500-08:00" level=debug msg="[GET]=>[/endpoints/b47d71f1-f086-4da3-a79f-04e1a84c94bc] Request : "
time="2023-12-13T09:35:59.969937100-08:00" level=debug msg="attach: stderr: end"
time="2023-12-13T09:35:59.969937100-08:00" level=debug msg="attach: stdin: end"
time="2023-12-13T09:35:59.970955100-08:00" level=debug msg="attach done"
time="2023-12-13T09:35:59.976176400-08:00" level=debug msg="Network Response : {\"ID\":\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\",\"Name\":\"Ethernet\",\"Version\":55834574851,\"AdditionalParams\":{},\"Resources\":{\"AdditionalParams\":{},\"AllocationOrder\":1,\"Allocators\":[{\"AdapterNetCfgInstanceId\":\"{A971EF28-ADB2-4D4C-9BB3-C1598F0B7737}\",\"AdditionalParams\":{},\"AllocationOrder\":0,\"CompartmendId\":3,\"Connected\":false,\"DNSFirewallRules\":false,\"DevicelessNic\":true,\"DhcpDisabled\":true,\"EndpointNicGuid\":\"68938729-CB79-438C-998E-870009ED1D29\",\"EndpointPortGuid\":\"437E1B98-0F7E-4BCA-89D8-3C68FE289C13\",\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625598573577},\"ID\":\"8A2486A8-9A1A-47CE-B2E7-2B18373B75E7\",\"InterfaceGuid\":\"A971EF28-ADB2-4D4C-9BB3-C1598F0B7737\",\"IsPolicy\":false,\"IsolationId\":0,\"MacAddress\":\"00-15-5D-DC-70-C9\",\"ManagementPort\":false,\"NcfHidden\":false,\"NicFriendlyName\":\"Ethernet\",\"NlmHidden\":false,\"PreferredPortFriendlyName\":\"B47D71F1-F086-4DA3-A79F-04E1A84C94BC\",\"State\":3,\"SwitchId\":\"3992BDF3-17D4-4DBB-AA65-E0BE4A900615\",\"Tag\":\"Endpoint Port\",\"WaitForIpv6Interface\":true,\"nonPersistentPort\":false}],\"CompartmentOperationTime\":0,\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625597356736},\"ID\":\"88D8C3E1-404B-4ADF-93CF-03CFAB02B838\",\"PortOperationTime\":78,\"State\":1,\"SwitchOperationTime\":0,\"VfpOperationTime\":0,\"parentId\":\"74FD4692-9F5B-4263-B71F-84D8EF70C68F\"},\"State\":1,\"VirtualNetwork\":\"3afd1ef0-5188-4597-bc61-36c34f81a176\",\"VirtualNetworkName\":\"nat\",\"MacAddress\":\"00-15-5D-DC-70-C9\",\"EnableInternalDNS\":true,\"IPAddress\":\"172.24.96.133\",\"PrefixLength\":20,\"GatewayAddress\":\"172.24.96.1\",\"IPSubnetId\":\"de42282e-f680-4fcb-a8b7-3ad303c6cb55\",\"DNSServerList\":\"172.24.96.1,[1.1.1.1, 8.8.8.8]\",\"SharedContainers\":[]}"
time="2023-12-13T09:35:59.976176400-08:00" level=debug msg="[GET]=>[/endpoints/b47d71f1-f086-4da3-a79f-04e1a84c94bc] Request : "
time="2023-12-13T09:35:59.977953000-08:00" level=debug msg="Network Response : {\"ID\":\"b47d71f1-f086-4da3-a79f-04e1a84c94bc\",\"Name\":\"Ethernet\",\"Version\":55834574851,\"AdditionalParams\":{},\"Resources\":{\"AdditionalParams\":{},\"AllocationOrder\":1,\"Allocators\":[{\"AdapterNetCfgInstanceId\":\"{A971EF28-ADB2-4D4C-9BB3-C1598F0B7737}\",\"AdditionalParams\":{},\"AllocationOrder\":0,\"CompartmendId\":3,\"Connected\":false,\"DNSFirewallRules\":false,\"DevicelessNic\":true,\"DhcpDisabled\":true,\"EndpointNicGuid\":\"68938729-CB79-438C-998E-870009ED1D29\",\"EndpointPortGuid\":\"437E1B98-0F7E-4BCA-89D8-3C68FE289C13\",\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625598573577},\"ID\":\"8A2486A8-9A1A-47CE-B2E7-2B18373B75E7\",\"InterfaceGuid\":\"A971EF28-ADB2-4D4C-9BB3-C1598F0B7737\",\"IsPolicy\":false,\"IsolationId\":0,\"MacAddress\":\"00-15-5D-DC-70-C9\",\"ManagementPort\":false,\"NcfHidden\":false,\"NicFriendlyName\":\"Ethernet\",\"NlmHidden\":false,\"PreferredPortFriendlyName\":\"B47D71F1-F086-4DA3-A79F-04E1A84C94BC\",\"State\":3,\"SwitchId\":\"3992BDF3-17D4-4DBB-AA65-E0BE4A900615\",\"Tag\":\"Endpoint Port\",\"WaitForIpv6Interface\":true,\"nonPersistentPort\":false}],\"CompartmentOperationTime\":0,\"Flags\":0,\"Health\":{\"LastErrorCode\":0,\"LastUpdateTime\":133469625597356736},\"ID\":\"88D8C3E1-404B-4ADF-93CF-03CFAB02B838\",\"PortOperationTime\":78,\"State\":1,\"SwitchOperationTime\":0,\"VfpOperationTime\":0,\"parentId\":\"74FD4692-9F5B-4263-B71F-84D8EF70C68F\"},\"State\":1,\"VirtualNetwork\":\"3afd1ef0-5188-4597-bc61-36c34f81a176\",\"VirtualNetworkName\":\"nat\",\"MacAddress\":\"00-15-5D-DC-70-C9\",\"EnableInternalDNS\":true,\"IPAddress\":\"172.24.96.133\",\"PrefixLength\":20,\"GatewayAddress\":\"172.24.96.1\",\"IPSubnetId\":\"de42282e-f680-4fcb-a8b7-3ad303c6cb55\",\"DNSServerList\":\"172.24.96.1,[1.1.1.1, 8.8.8.8]\",\"SharedContainers\":[]}"
time="2023-12-13T09:35:59.979566000-08:00" level=debug msg="[DELETE]=>[/endpoints/b47d71f1-f086-4da3-a79f-04e1a84c94bc] Request : "
time="2023-12-13T09:35:59.979566000-08:00" level=debug msg="7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269 (ef24ae8).deleteSvcRecords(runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined, 172.24.96.133, <nil>, true) updateSvcRecord sid:7cc467a43a84e5603c946a10fc1c8bde0ba8de13769a673119c96d06c0079269 "
time="2023-12-13T09:36:00.021545400-08:00" level=debug msg="Releasing addresses for endpoint runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-predefined's interface on network nat"
time="2023-12-13T09:36:00.021606800-08:00" level=debug msg="ReleaseAddress(172.24.96.0/20, 172.24.96.133)"
time="2023-12-13T09:36:00.025579900-08:00" level=debug msg="WindowsGraphDriver Put() id ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320"
time="2023-12-13T09:36:00.069611300-08:00" level=error msg="Handler for POST /v1.43/containers/ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320/start returned error: hcs::CreateComputeSystem ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320: The parameter is incorrect."
time="2023-12-13T09:36:00.070825700-08:00" level=debug msg="Closing buffered stdin pipe"
time="2023-12-13T09:36:00.075936700-08:00" level=debug msg="Calling GET /v1.43/networks"
time="2023-12-13T09:36:00.077112100-08:00" level=debug msg="Calling DELETE /v1.43/containers/ebdc96f03774dab0cabf9c53d9e68eefe565a3e3209a55425ce93a26d014b320?force=1&v=1"
time="2023-12-13T09:36:00.085996000-08:00" level=debug msg="Calling DELETE /v1.43/volumes/runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7?force=1"
time="2023-12-13T09:36:00.086059600-08:00" level=debug msg="Removing volume reference: driver local, name runner-8gdxv7ep9-project-1525-concurrent-0-f0ed9de41591b337-cache-755650d3877d687c50b15f2d7f907be7"
time="2023-12-13T09:36:27.108738900-08:00" level=info msg="Processing signal 'interrupt'"
time="2023-12-13T09:36:27.111210300-08:00" level=debug msg="daemon configured with a 15 seconds minimum shutdown timeout"
time="2023-12-13T09:36:27.111771200-08:00" level=debug msg="start clean shutdown of all containers with a 15 seconds timeout..."
time="2023-12-13T09:36:27.113033600-08:00" level=debug msg="Clean shutdown succeeded"
time="2023-12-13T09:36:27.113871100-08:00" level=info msg="Daemon shutdown complete"
PS C:\Users\Administrator>

Steps to reproduce

.gitlab-ci.yml

windows hello world:
  image: mcr.microsoft.com/windows/servercore:ltsc2022
  stage: "preparation"
  tags:
    - 'docker'
    - 'windows'
    - '2022'
  script:
    - echo "Hello World"

Environment description

This is about our self-hosted shared runners for https://gitlab.freedesktop.org/

Our runners are a Windows Server 2022 VMs running under KVM on Ubuntu 22.04 host. The setup is simpleish and has been working fine for a couple years now.

virt-install \
    --autostart \
    --virt-type=kvm \
    --boot uefi \
    --name=server2022 \
    --ram=98304 \
    --cpu=host,require=pdpe1gb,require=svm,disable=vmx,require=ibpb,require=stibp,require=virt-ssbd,require=amd-ssbd  \
    --features=hyperv_relaxed=on,hyperv_vapic=on,hyperv_spinlocks=on,hyperv_spinlocks_retries=8191 \
    --clock=hypervclock_present=yes \
    --vcpus=$cores \
    --os-variant=win2k22 \
    --disk /srv/SW_DVD9_Win_Server_STD_CORE_2022_2108.15_64Bit_English_DC_STD_MLF_X23-31801.ISO,boot_order=1,device=cdrom \
    --disk /srv/server2022.raw,size=6656,cache=writethrough,bus=virtio,boot_order=2 \
    --disk /srv/virtio-win.iso,boot_order=3,device=cdrom \
    --boot cdrom,hd,menu=on \
    --network=default,model=virtio \
    --graphics vnc,listen=127.0.0.1,port=5902,password=""

And inside windows it's the following:

We used to install docker like this, but microsoft changed this recently to a custom script instead. This is basically the only change compared to the other working runner we still have.

Old:

Enable-WindowsOptionalFeature -Online -FeatureName containers –All
Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
Install-Package -Name docker -ProviderName DockerMsftProvider
Restart-Computer -Force

New:

from https://learn.microsoft.com/en-us/virtualization/windowscontainers/quick-start/set-up-environment?tabs=dockerce

Invoke-WebRequest -UseBasicParsing "https://raw.githubusercontent.com/microsoft/Windows-Containers/Main/helpful_tools/Install-DockerCE/install-docker-ce.ps1" -o install-docker-ce.ps1
.\install-docker-ce.ps1

We use chocolatey to install gitlab-runner for convinience but I also tested with a locally build binaries from git as mentioend above.

Set-ExecutionPolicy Bypass -Scope Process -Force; iex ((New-Object System.Net.WebClient).DownloadString('https://chocolatey.org/install.ps1'))
choco install -y git --params "/NoAutoCrlf /NoCredentialManager /NoShellHereIntegration /NoGuiHereIntegration /NoShellIntegration"
choco install -y gitlab-runner

(Needs helper_image workaround, tested with and without still same errors)

config.toml contents

concurrent = 4
check_interval = 11
shutdown_timeout = 0

[session_server]
  session_timeout = 1800

[[runners]]
  name = "WIN-M9O8VUVFMMT"
  url = "https://gitlab.freedesktop.org/"
  id = 3643
  token = ""
  token_obtained_at = 2023-12-13T17:12:53Z
  token_expires_at = 0001-01-01T00:00:00Z
  executor = "docker-windows"
  builds_dir = "C:/Users/Administrator/runner/builds"
  environment = ["FDO_CI_CONCURRENT=16"]
  shell = "powershell"
  [runners.docker]
    tls_verify = false
    image = "mcr.microsoft.com/windows/servercore:ltsc2022"
    helper_image = "kdeorg/gitlab-windows-runner-helper:servercoreltsc2022"
    dns = ["[1.1.1.1, 8.8.8.8]"]
    privileged = false
    disable_entrypoint_overwrite = false
    oom_kill_disable = false
    disable_cache = true
    volumes = ["c:\\cache"]
    pull_policy = ["always"]
    shm_size = 0
    network_mtu = 0

Used GitLab Runner version

Tested with gitlab-runner 16.3.1, 16.6.0, 16.6.1 and git build from b0f161fa And with docker versions: Docker version 20.10.9, build 591094d and Docker version 24.0.7, build afdd53b

(20.10.9 from DockerMsftProvider is what we have on the still working runner, but matching the installed version with the new docker-ce script didn't get it to work, so sounds like there's a difference in how the docker-ce build is distributed now)