Using fastzip causes artifact upload error

  • I have on-premises gitlab 13.8.3 and runners 13.8.0.
  • I used FF_USE_FASTZIP: "true" globally in .gitlab-ci.yml
  • I have mostly large binary artifacts. In one job compression/upload step was reduced from 13 minutes to 3 minutes (hooray, feature stays :-) )
  • In 2 different jobs I have reproductible problem:
Uploading artifacts for successful job
03:25
Uploading artifacts...
Runtime platform                                    arch=amd64 os=linux pid=30528 revision=775dd39d version=13.8.0
/home/gitlab-runner/builds/7/1/borg-borg-engine/source/borg-master/borg-engine/output/borg-master/tui_monolitR/: found 21 matching files and directories 
ERROR: Uploading artifacts as "archive" to coordinator... error  error=couldn't execute POST against https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: Post https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: EOF id=453052 token=3zpEVM1X
WARNING: Retrying...                                context=artifacts-uploader error=invalid argument
ERROR: Uploading artifacts as "archive" to coordinator... error  error=couldn't execute POST against https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: Post https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: EOF id=453052 token=3zpEVM1X
WARNING: Retrying...                                context=artifacts-uploader error=invalid argument
ERROR: Uploading artifacts as "archive" to coordinator... error  error=couldn't execute POST against https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: Post https://rick.billongroup.com/api/v4/jobs/453052/artifacts?artifact_format=zip&artifact_type=archive&expire_in=4+days: EOF id=453052 token=3zpEVM1X
FATAL: invalid argument                            
Cleaning up file based variables
00:00
ERROR: Job failed: exit status 1
  • Those two particular jobs are not obviously unique as far as I can see - they neither have largest artifacts nor of different type. However they are several GB of binary data.

I have admin access to server, so I can provide some logs if you request any.