object store multipart (authentication) issue
The runners are unable to save job artifacts. I've attempted some things * build a container with the latest v6.1.0 workhorse
time="2018-09-12T17:04:02Z" level=error msg=error error="handleFileUploads: extract files from multipart: Persisting multipart file: Cannot upload part 1: PUT request http://host/gitlabsr-artifacts-bucket/tmp/uploads/1536771841-43-0001-9060-fb94549f6ebec230a3ea47803a81478c?uploadId=2~edQLC1jcyCJwBnkdlongHQEn0ut9QwN&partNumber=1&AWSAccessKeyId=...&Signature=[FILTERED]&Expires=1536787142 returned: 403 Forbidden" method=POST uri="/api/v4/jobs/582/artifacts?"
host 10.244.5.127:55278 - - [2018/09/12:17:04:02 +0000] "POST /api/v4/jobs/582/artifacts? HTTP/1.1" 500 22 "" "gitlab-runner 10.3.0 (10-3-stable; go1.8.5; linux/amd64)" 0.322
S3 config:
provider: AWS aws_access_key_id: <...> aws_secret_access_key: <...> endpoint: http://host host: host path_style: true aws_signature_version: 2
Other objects are stored properly (from Fog clients, through Ruby, all in that bucket) and the docker registry is also storing multipart files on the same server (different bucket). The backend is an S3 compatible Ceph RadosGW (12.2.7, deployed through Rook.io).
I have also tried a container with the latest v6.1.0 workhorse (which gave a problem for some GUI files/scripts, but otherwise behaved identical to last released v5.0.0 CNG image). aws_signature_version v2/v4 gives the same problem.
2018-09-12 17:20:35.049044 I | rgw: 2018-09-12 17:20:35.049005 7f3f0ff03700 1 civetweb: 0x55fe088cb000: a.b.c.d - - [12/Sep/2018:17:20:35 +0000] "PUT /gitlabsr-artifacts-bucket/tmp/uploads/1536772835-49-0002-9524-60fd8087456bc8c3168127af79d3bd86?uploadId=2~cm5ZijSaAky-6cxmigI5TOshxBv_EAl&partNumber=1&AWSAccessKeyId=...&Signature=893p2i1ktFjTPkHG7qcFA9eaF5I%!D(MISSING)&Expires=1536788135 HTTP/1.1" 403 0 - Go-http-client/1.1
I'll try to get more debug out of the ceph rgw to find out what exactly is causing the 403.
If there would be any configuration options I could try to work around this multipart issue, that would be greatly appreciated.