12.4.0: All jobs fail with SSL certificate problem: self signed certificate in certificate chain
Summary
In the morning, after we have an upgrade of gitalb-runner from 12.3 to 12.4.0, now all our jobs failed at git fetch with error message
fatal: unable to access 'https://gitlab-ci-token:[MASKED]@192.168.3.137/iHandle/general/building_hebei_app.git/': SSL certificate problem: self signed certificate in certificate chain
this looks like the same issue of #4805 (closed) , as we are using a self-signed certificate, the error message is different.
Our self-signed certificate was stored in a crt file and specified in the config.toml file. GitLab-runner worked well up to 12.3 without SSL problem.
Steps to reproduce
GitLab-runner is installed on Centos 7. The job
job failure log
Running with gitlab-runner 12.4.0 (1564076b)
on simulator_60 66a9939b
Using Docker executor with image 192.168.3.133:444/gradle_basic:3.0 ...
WARNING: Container based cache volumes creation is disabled. Will not create volume for "/cache"
Authenticating with credentials from $DOCKER_AUTH_CONFIG
Pulling docker image 192.168.3.133:444/gradle_basic:3.0 ...
Using docker image sha256:5a712225ab3c445d3fd8bb788749872327591b5200e377ba7750869e57f25816 for 192.168.3.133:444/gradle_basic:3.0 ...
Running on runner-66a9939b-project-1002-concurrent-0 via SH-DO...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/iHandle/general/building_hebei_app/.git/
Created fresh repository.
fatal: unable to access 'https://gitlab-ci-token:[MASKED]@192.168.3.137/iHandle/general/building_hebei_app.git/': SSL certificate problem: self signed certificate in certificate chain
ERROR: Job failed: exit code 1
Relevant logs and/or screenshots
job running under gitalb-runner 12.3
Running with gitlab-runner 12.3.0 (a8a019e0)
on runner_17 7f901dd6
Using Docker executor with image 192.168.3.133:444/gradle_basic:3.0 ...
WARNING: Container based cache volumes creation is disabled. Will not create volume for "/cache"
Authenticating with credentials from $DOCKER_AUTH_CONFIG
Pulling docker image 192.168.3.133:444/gradle_basic:3.0 ...
Using docker image sha256:5a712225ab3c445d3fd8bb788749872327591b5200e377ba7750869e57f25816 for 192.168.3.133:444/gradle_basic:3.0 ...
Running on runner-7f901dd6-project-1002-concurrent-0 via master...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/iHandle/general/building_hebei_app/.git/
Created fresh repository.
From https://192.168.3.137/iHandle/general/building_hebei_app
* [new branch] develop -> origin/develop
Checking out 6f281e74 as develop...
Environment description
config.toml contents
concurrent = 1
check_interval = 0
[session_server]
session_timeout = 7200
[[runners]]
name = "simulator_60"
output_limit = 409600
url = "https://192.168.3.137/"
token = "66a9939b81af8869f2247cb30a394c"
tls-ca-file = "/etc/gitlab-runner/config/nsb-root.crt"
executor = "docker"
clone_url = "https://192.168.3.137/"
[runners.custom_build_dir]
[runners.docker]
tls_verify = false
image = "ubuntu"
privileged = true
disable_entrypoint_overwrite = false
oom_kill_disable = false
disable_cache = true
volumes = ["/dev/kvm:/dev/kvm", "/cache"]
shm_size = 0
[runners.cache]
[runners.cache.s3]
ServerAddress = "192.168.3.133:9005"
AccessKey = "XXXXXXXXXXXXXXXXXXXX"
SecretKey = "XXXXXXXXXXXXXXXXXXXXXXXXX"
BucketName = "runner"
Insecure = true
[runners.cache.gcs]
[[runners]]
name = "socket_60"
output_limit = 409600
url = "https://192.168.3.137/"
token = "9cb2dc9e0f169025a31cc54ad480e7"
tls-ca-file = "/etc/gitlab-runner/config/nsb-root.crt"
executor = "docker"
clone_url = "https://192.168.3.137/"
[runners.custom_build_dir]
[runners.docker]
tls_verify = false
image = "ubuntu"
privileged = true
disable_entrypoint_overwrite = false
oom_kill_disable = false
disable_cache = true
volumes = ["/var/run/docker.sock:/var/run/docker.sock", "/cache"]
shm_size = 0
[runners.cache]
[runners.cache.s3]
ServerAddress = "192.168.3.133:9005"
AccessKey = "XXXXXXXXXXXXXXXXXXXX"
SecretKey = "XXXXXXXXXXXXXXXXXXXXXXXXX"
BucketName = "runner"
Insecure = true
[runners.cache.gcs]
the self-signed certificate
-----BEGIN CERTIFICATE-----
MIIKeDCCBmCgAwIBAgIJALRR92P5zX1PMA0GCSqGSIb3DQEBCwUAMIHIMQswCQYD
VQQGEwJDTjERMA8GA1UECAwIU2hhbmdoYWkxITAfBgNVBAoMGE5va2lhIFNoYW5n
aGFpIEJlbGwgTHRkLjEyMDAGA1UECwwpTm9raWEgU2hhbmdoYWkgQmVsbCBDZXJ0
aWZpY2F0ZSBBdXRocm9pdHkxJDAiBgNVBAMMG05va2lhIFNoYW5naGFpIEJlbGwg
Um9vdCBDQTEpMCcGCSqGSIb3DQEJARYacm9uZy5saWFuZ0Bub2tpYS1zYmVsbC5j
b20wHhcNMTkwMjE2MTIzODU4WhcNMzkwMjExMTIzODU4WjCByDELMAkGA1UEBhMC
Q04xETAPBgNVBAgMCFNoYW5naGFpMSEwHwYDVQQKDBhOb2tpYSBTaGFuZ2hhaSBC
ZWxsIEx0ZC4xMjAwBgNVBAsMKU5va2lhIFNoYW5naGFpIEJlbGwgQ2VydGlmaWNh
dGUgQXV0aHJvaXR5MSQwIgYDVQQDDBtOb2tpYSBTaGFuZ2hhaSBCZWxsIFJvb3Qg
Q0ExKTAnBgkqhkiG9w0BCQEWGnJvbmcubGlhbmdAbm9raWEtc2JlbGwuY29tMIIE
IjANBgkqhkiG9w0BAQEFAAOCBA8AMIIECgKCBAEAtyPrRr7AFljQU/uhcomGm93U
Gi1vzJ+tjuIxG+RMladch6W2jYVYCjfq+CY7HbDIeNgo0tHnDCnXlB1rdHnTWn9h
fntpoq3XYw4SGDEQ7g2IEKCRD5/hfGt4dRBaTfCYhmfJnACw2tnJhFmjq/vVRVv2
C6Zf1vdIRI1QZgP7PAvN6UAZfEh3P0894Ec7tbuU0AtLFEC1H3x2A1Wogx+QyCJ5
lQ/TzzD0NZauGJb9IUtfoAvTXY6iJOUhkuAHrEt1RM+T+XlcidEwzI6TRbqDIH5V
M3KdLbvJjjJh8/vGG+MA0Vi7xqpeO2jMkGSeyYX9u1SBzZ6zSsAxsgmyt0N592l6
BSdiZ6bIJpJRqLQk/qjtMHHPnTxzBlVWSW/c8LC1/BInl01imun/+Rp/H1g/qa06
rc6/T4Cx08USSIlyOw6+uBRQnySyCA9j40rjZYGDV1Gwzg0MsmziWefV+5aE/UGi
AKUFaWmIk6NkA5kerOPujiPKyZkFhgvmT7ZOdTy2PLItX3+Lb+wIsTR7W9DCCsgD
WV94djb8FJCl8AqX/sictWbLnJaAxWYle0ZXL9YFLCtslSSdSlJ3qjH/V9fqyztO
hUA/Fs5mgZXWs83YoqsKGV6OOsCmXXhjjPtBKWVd+FMbZ227SYwfyS4H5ROG5+WG
a4itNMm+G/BVoX//2UQPPMbH4UEK8Q77bHeW5LJAXE9DbGcjW+QC4w+Ix1/89Dqi
HcZLondQbeStqbYj/j7pS9mw36Tf/5klsOgm30onmhrNTtQrqa8ipO25rK8rXdV+
I3a91O5XxZErAV5pr0nmzkRMGfSv3SPu1f36Ei0weo2fX1zOnPkcLen0n3YW2cYM
WnxiEmvbZ9cawSjNIdRT5Y71j/whfjRiMiFW3uGX9PLbGjQSPP9ELd0uEcDdKPdW
gBCMsW0AzCLfFINxzG/4HzNcYl+xzuo8szzj85rr87ZgVOJkMRA3GaT3mEqzmf6X
fLEpEhrTTWLq+kH9Hgpr73UqBwGup9wMa4fSXqLdY4HA1/Fv19ukJSHlszjhn5Jc
rxOzq649xPYyW7QA1bLo+IVRXcFPRghxPUT8ArxWWt8Wgs5Q38UnqbRWfk5nxkMc
HHv+kzLTA5sTuPtl32wkJNJKqWfFqyd+jwPfz7lSZyvFc40vrWnETEUWGkRbonrt
3MeCslDOgOUAVXT1/0bNcNIk9JW3vzHcGADacS2wtxBaeAI2pw2c/71U86sgwFUL
tYMC2RxVWtlfwvmN2BCV9zthYShYAAFu5RpGWIzB6RrRkRS5GAZDHETgChjZe4wx
HY74tFPalnzOPOQwyo4l7atjRp4AJddB5yc3126ENvjLYc1d78sJ6mb9R6vyEwID
AQABo2MwYTAdBgNVHQ4EFgQUTNiCvtWFXlz9LYu1xsrbSEPjPtMwHwYDVR0jBBgw
FoAUTNiCvtWFXlz9LYu1xsrbSEPjPtMwDwYDVR0TAQH/BAUwAwEB/zAOBgNVHQ8B
Af8EBAMCAYYwDQYJKoZIhvcNAQELBQADggQBAAfrpjoplK28ax0jos2Y3qF3CpVR
uc3m3ynoj+GWRXzmg3TBbuw7xjcZ+Tx4j1C2U4CIKVnIO+GcZ0Ah2WMMH3bQ8rx6
3fb3/89qtyn1acC/+JB2K5qSc8CouXCVswFzXeZBoGPQumYEbyyfk+B1y0sYF9S+
7mZBE49HIsk6PO95aGqpRqwd1aKyZaTybTF3tsTmIHbzXMNn8b96LV2XfueQOETC
YP43ZDAHV4qbsHboluBYWxnc+KFihFOkhHewhzol7SvjqhVUyb7DvqicwyAIc2+d
GSQrQZUtvP4Ic303VQ4eorrl/Wxekp7SvXNUHquwdoXF9uLiBZgugByRZgxk4UeY
RdIK+MVH2TdnX9D0Da3JxErA/Wx8s66up8OvOdpbwqDPB9q3Hc3J5pVZUa+wfTtG
ClGYKl0sGS/s2tz00U244oWeAWe+EqJwRljsavj6Dg0vFTOdfC5bP3PPCWmXJwu8
jInU41u9dqSMEjxpxVWUM4raN+COVTZReZPWQSZVzWzqBysdAviXKmr/OlIMhFPx
j2YBFwTM9goyCqFp8OWYcXUp4s7//YhLRb4LeRDgmFM+VVgIUgzNT7ByzuNRj5iN
Kq9gJop6UULjuj6iOCnuaVdsbqxA+xZjemEE1pN7nxPIiAGSf3kyr4//TuFQPO0i
VwZ2KG1xVugS0g04wADZX7EDgws/HdldtzNV7zVMCyYEaP21uykOdOUj2osqT0Rf
jWGXaa3JoJfhdqgjEN8wZQEL3DJ1ejMV5VtQIABoRktZXsSKQMBE/bcHMGuZiaSr
LwaK/67bJyZK6zSelrDi7kngRs3PvXxCxrdAsE5HHQlr73ammgEtIcvLg7IPZKoX
URRWyX7npgQvU/mpCUgcVoJm5vRYuAMB9uG2vNnRnEwF6/HJ5dMh6Dwpaj+UCsNk
t8ggd8+sVpCM06Hk6IJkDqhOuGXvEm/KZ5cfwx1PRxKnUAoCBmjM7DX1AI2G5JNr
79ID+WThHfgRi6rxXgvFASc6+Ulkfjrl3g2cACdDvfacZJ4vzkggvPJKLsfTsU0g
PGPH8bIBWeHRpTKfbUWnXzy9C+Hokiy3KT6eeqg4lJkaVSI1vLEsycDOLEt3TCJH
zaYExTy+LCB1X5PufcYN/hfN4R7eG9Zg5c0lmZikw0j1f/OfFB7VHn+Dakqo5hJw
nEcDeAlIWpdqNhPr+ok4tZRj4uKXv3AkiLDvTOe7HxDS4A6VfjAfWYE8RbtiRUos
MuwNnPSRq3JasRjrUWmMK5271BnMjekEBOmLsqx4tcobFjluSy34JCEX7eis+1r/
sIvroT/woenrKAXQnIMT6r4WcfoYCdUXOLMK5Y9s5ZXRDH8w+Y9CNAdEZAM=
-----END CERTIFICATE-----