Skip to content

12.4.0: All jobs fail with SSL certificate problem: self signed certificate in certificate chain

Summary

In the morning, after we have an upgrade of gitalb-runner from 12.3 to 12.4.0, now all our jobs failed at git fetch with error message

fatal: unable to access 'https://gitlab-ci-token:[MASKED]@192.168.3.137/iHandle/general/building_hebei_app.git/': SSL certificate problem: self signed certificate in certificate chain

this looks like the same issue of #4805 (closed) , as we are using a self-signed certificate, the error message is different.

Our self-signed certificate was stored in a crt file and specified in the config.toml file. GitLab-runner worked well up to 12.3 without SSL problem.

Steps to reproduce

GitLab-runner is installed on Centos 7. The job

job failure log
Running with gitlab-runner 12.4.0 (1564076b)
  on simulator_60 66a9939b
Using Docker executor with image 192.168.3.133:444/gradle_basic:3.0 ...
WARNING: Container based cache volumes creation is disabled. Will not create volume for "/cache"
Authenticating with credentials from $DOCKER_AUTH_CONFIG
Pulling docker image 192.168.3.133:444/gradle_basic:3.0 ...
Using docker image sha256:5a712225ab3c445d3fd8bb788749872327591b5200e377ba7750869e57f25816 for 192.168.3.133:444/gradle_basic:3.0 ...
Running on runner-66a9939b-project-1002-concurrent-0 via SH-DO...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/iHandle/general/building_hebei_app/.git/
Created fresh repository.
fatal: unable to access 'https://gitlab-ci-token:[MASKED]@192.168.3.137/iHandle/general/building_hebei_app.git/': SSL certificate problem: self signed certificate in certificate chain
ERROR: Job failed: exit code 1

Relevant logs and/or screenshots

job running under gitalb-runner 12.3
Running with gitlab-runner 12.3.0 (a8a019e0)
  on runner_17 7f901dd6
Using Docker executor with image 192.168.3.133:444/gradle_basic:3.0 ...
WARNING: Container based cache volumes creation is disabled. Will not create volume for "/cache"
Authenticating with credentials from $DOCKER_AUTH_CONFIG
Pulling docker image 192.168.3.133:444/gradle_basic:3.0 ...
Using docker image sha256:5a712225ab3c445d3fd8bb788749872327591b5200e377ba7750869e57f25816 for 192.168.3.133:444/gradle_basic:3.0 ...
Running on runner-7f901dd6-project-1002-concurrent-0 via master...
Fetching changes with git depth set to 50...
Initialized empty Git repository in /builds/iHandle/general/building_hebei_app/.git/
Created fresh repository.
From https://192.168.3.137/iHandle/general/building_hebei_app
 * [new branch]      develop    -> origin/develop
Checking out 6f281e74 as develop...

Environment description

config.toml contents
concurrent = 1
check_interval = 0

[session_server]
  session_timeout = 7200

[[runners]]
  name = "simulator_60"
  output_limit = 409600
  url = "https://192.168.3.137/"
  token = "66a9939b81af8869f2247cb30a394c"
  tls-ca-file = "/etc/gitlab-runner/config/nsb-root.crt"
  executor = "docker"
  clone_url = "https://192.168.3.137/"
  [runners.custom_build_dir]
  [runners.docker]
    tls_verify = false
    image = "ubuntu"
    privileged = true
    disable_entrypoint_overwrite = false
    oom_kill_disable = false
    disable_cache = true
    volumes = ["/dev/kvm:/dev/kvm", "/cache"]
    shm_size = 0
  [runners.cache]
    [runners.cache.s3]
      ServerAddress = "192.168.3.133:9005"
      AccessKey = "XXXXXXXXXXXXXXXXXXXX"
      SecretKey = "XXXXXXXXXXXXXXXXXXXXXXXXX"
      BucketName = "runner"
      Insecure = true
    [runners.cache.gcs]

[[runners]]
  name = "socket_60"
  output_limit = 409600
  url = "https://192.168.3.137/"
  token = "9cb2dc9e0f169025a31cc54ad480e7"
  tls-ca-file = "/etc/gitlab-runner/config/nsb-root.crt"
  executor = "docker"
  clone_url = "https://192.168.3.137/"
  [runners.custom_build_dir]
  [runners.docker]
    tls_verify = false
    image = "ubuntu"
    privileged = true
    disable_entrypoint_overwrite = false
    oom_kill_disable = false
    disable_cache = true
    volumes = ["/var/run/docker.sock:/var/run/docker.sock", "/cache"]
    shm_size = 0
  [runners.cache]
    [runners.cache.s3]
      ServerAddress = "192.168.3.133:9005"
      AccessKey = "XXXXXXXXXXXXXXXXXXXX"
      SecretKey = "XXXXXXXXXXXXXXXXXXXXXXXXX"
      BucketName = "runner"
      Insecure = true
    [runners.cache.gcs]
the self-signed certificate
-----BEGIN CERTIFICATE-----
MIIKeDCCBmCgAwIBAgIJALRR92P5zX1PMA0GCSqGSIb3DQEBCwUAMIHIMQswCQYD
VQQGEwJDTjERMA8GA1UECAwIU2hhbmdoYWkxITAfBgNVBAoMGE5va2lhIFNoYW5n
aGFpIEJlbGwgTHRkLjEyMDAGA1UECwwpTm9raWEgU2hhbmdoYWkgQmVsbCBDZXJ0
aWZpY2F0ZSBBdXRocm9pdHkxJDAiBgNVBAMMG05va2lhIFNoYW5naGFpIEJlbGwg
Um9vdCBDQTEpMCcGCSqGSIb3DQEJARYacm9uZy5saWFuZ0Bub2tpYS1zYmVsbC5j
b20wHhcNMTkwMjE2MTIzODU4WhcNMzkwMjExMTIzODU4WjCByDELMAkGA1UEBhMC
Q04xETAPBgNVBAgMCFNoYW5naGFpMSEwHwYDVQQKDBhOb2tpYSBTaGFuZ2hhaSBC
ZWxsIEx0ZC4xMjAwBgNVBAsMKU5va2lhIFNoYW5naGFpIEJlbGwgQ2VydGlmaWNh
dGUgQXV0aHJvaXR5MSQwIgYDVQQDDBtOb2tpYSBTaGFuZ2hhaSBCZWxsIFJvb3Qg
Q0ExKTAnBgkqhkiG9w0BCQEWGnJvbmcubGlhbmdAbm9raWEtc2JlbGwuY29tMIIE
IjANBgkqhkiG9w0BAQEFAAOCBA8AMIIECgKCBAEAtyPrRr7AFljQU/uhcomGm93U
Gi1vzJ+tjuIxG+RMladch6W2jYVYCjfq+CY7HbDIeNgo0tHnDCnXlB1rdHnTWn9h
fntpoq3XYw4SGDEQ7g2IEKCRD5/hfGt4dRBaTfCYhmfJnACw2tnJhFmjq/vVRVv2
C6Zf1vdIRI1QZgP7PAvN6UAZfEh3P0894Ec7tbuU0AtLFEC1H3x2A1Wogx+QyCJ5
lQ/TzzD0NZauGJb9IUtfoAvTXY6iJOUhkuAHrEt1RM+T+XlcidEwzI6TRbqDIH5V
M3KdLbvJjjJh8/vGG+MA0Vi7xqpeO2jMkGSeyYX9u1SBzZ6zSsAxsgmyt0N592l6
BSdiZ6bIJpJRqLQk/qjtMHHPnTxzBlVWSW/c8LC1/BInl01imun/+Rp/H1g/qa06
rc6/T4Cx08USSIlyOw6+uBRQnySyCA9j40rjZYGDV1Gwzg0MsmziWefV+5aE/UGi
AKUFaWmIk6NkA5kerOPujiPKyZkFhgvmT7ZOdTy2PLItX3+Lb+wIsTR7W9DCCsgD
WV94djb8FJCl8AqX/sictWbLnJaAxWYle0ZXL9YFLCtslSSdSlJ3qjH/V9fqyztO
hUA/Fs5mgZXWs83YoqsKGV6OOsCmXXhjjPtBKWVd+FMbZ227SYwfyS4H5ROG5+WG
a4itNMm+G/BVoX//2UQPPMbH4UEK8Q77bHeW5LJAXE9DbGcjW+QC4w+Ix1/89Dqi
HcZLondQbeStqbYj/j7pS9mw36Tf/5klsOgm30onmhrNTtQrqa8ipO25rK8rXdV+
I3a91O5XxZErAV5pr0nmzkRMGfSv3SPu1f36Ei0weo2fX1zOnPkcLen0n3YW2cYM
WnxiEmvbZ9cawSjNIdRT5Y71j/whfjRiMiFW3uGX9PLbGjQSPP9ELd0uEcDdKPdW
gBCMsW0AzCLfFINxzG/4HzNcYl+xzuo8szzj85rr87ZgVOJkMRA3GaT3mEqzmf6X
fLEpEhrTTWLq+kH9Hgpr73UqBwGup9wMa4fSXqLdY4HA1/Fv19ukJSHlszjhn5Jc
rxOzq649xPYyW7QA1bLo+IVRXcFPRghxPUT8ArxWWt8Wgs5Q38UnqbRWfk5nxkMc
HHv+kzLTA5sTuPtl32wkJNJKqWfFqyd+jwPfz7lSZyvFc40vrWnETEUWGkRbonrt
3MeCslDOgOUAVXT1/0bNcNIk9JW3vzHcGADacS2wtxBaeAI2pw2c/71U86sgwFUL
tYMC2RxVWtlfwvmN2BCV9zthYShYAAFu5RpGWIzB6RrRkRS5GAZDHETgChjZe4wx
HY74tFPalnzOPOQwyo4l7atjRp4AJddB5yc3126ENvjLYc1d78sJ6mb9R6vyEwID
AQABo2MwYTAdBgNVHQ4EFgQUTNiCvtWFXlz9LYu1xsrbSEPjPtMwHwYDVR0jBBgw
FoAUTNiCvtWFXlz9LYu1xsrbSEPjPtMwDwYDVR0TAQH/BAUwAwEB/zAOBgNVHQ8B
Af8EBAMCAYYwDQYJKoZIhvcNAQELBQADggQBAAfrpjoplK28ax0jos2Y3qF3CpVR
uc3m3ynoj+GWRXzmg3TBbuw7xjcZ+Tx4j1C2U4CIKVnIO+GcZ0Ah2WMMH3bQ8rx6
3fb3/89qtyn1acC/+JB2K5qSc8CouXCVswFzXeZBoGPQumYEbyyfk+B1y0sYF9S+
7mZBE49HIsk6PO95aGqpRqwd1aKyZaTybTF3tsTmIHbzXMNn8b96LV2XfueQOETC
YP43ZDAHV4qbsHboluBYWxnc+KFihFOkhHewhzol7SvjqhVUyb7DvqicwyAIc2+d
GSQrQZUtvP4Ic303VQ4eorrl/Wxekp7SvXNUHquwdoXF9uLiBZgugByRZgxk4UeY
RdIK+MVH2TdnX9D0Da3JxErA/Wx8s66up8OvOdpbwqDPB9q3Hc3J5pVZUa+wfTtG
ClGYKl0sGS/s2tz00U244oWeAWe+EqJwRljsavj6Dg0vFTOdfC5bP3PPCWmXJwu8
jInU41u9dqSMEjxpxVWUM4raN+COVTZReZPWQSZVzWzqBysdAviXKmr/OlIMhFPx
j2YBFwTM9goyCqFp8OWYcXUp4s7//YhLRb4LeRDgmFM+VVgIUgzNT7ByzuNRj5iN
Kq9gJop6UULjuj6iOCnuaVdsbqxA+xZjemEE1pN7nxPIiAGSf3kyr4//TuFQPO0i
VwZ2KG1xVugS0g04wADZX7EDgws/HdldtzNV7zVMCyYEaP21uykOdOUj2osqT0Rf
jWGXaa3JoJfhdqgjEN8wZQEL3DJ1ejMV5VtQIABoRktZXsSKQMBE/bcHMGuZiaSr
LwaK/67bJyZK6zSelrDi7kngRs3PvXxCxrdAsE5HHQlr73ammgEtIcvLg7IPZKoX
URRWyX7npgQvU/mpCUgcVoJm5vRYuAMB9uG2vNnRnEwF6/HJ5dMh6Dwpaj+UCsNk
t8ggd8+sVpCM06Hk6IJkDqhOuGXvEm/KZ5cfwx1PRxKnUAoCBmjM7DX1AI2G5JNr
79ID+WThHfgRi6rxXgvFASc6+Ulkfjrl3g2cACdDvfacZJ4vzkggvPJKLsfTsU0g
PGPH8bIBWeHRpTKfbUWnXzy9C+Hokiy3KT6eeqg4lJkaVSI1vLEsycDOLEt3TCJH
zaYExTy+LCB1X5PufcYN/hfN4R7eG9Zg5c0lmZikw0j1f/OfFB7VHn+Dakqo5hJw
nEcDeAlIWpdqNhPr+ok4tZRj4uKXv3AkiLDvTOe7HxDS4A6VfjAfWYE8RbtiRUos
MuwNnPSRq3JasRjrUWmMK5271BnMjekEBOmLsqx4tcobFjluSy34JCEX7eis+1r/
sIvroT/woenrKAXQnIMT6r4WcfoYCdUXOLMK5Y9s5ZXRDH8w+Y9CNAdEZAM=
-----END CERTIFICATE-----