Skip to content

Set multipart_chunk_size_mb in s3cfg backups storage examples

Blake Burkhart requested to merge bburky/gitlab:patch-1 into master

What does this MR do?

Set multipart_chunk_size_mb in s3cfg backups storage examples

The value multipart_chunk_size_mb = 128 is selected to match the minio configuration:
https://gitlab.com/gitlab-org/charts/gitlab/-/blob/397da18fe99d870b77492c981d49384427473e70/charts/gitlab/charts/task-runner/templates/configmap.yaml#L127

Otherwise, the s3cmd default value of 15MB is used and large backups have the following error:

ERROR: Parameter problem: Chunk size 15 MB results in more than 10000 chunks. Please increase --multipart-chunk-size-mb

Related issues

Minio configuration: #1495 (closed) !884 (merged)

Checklist

See Definition of done.

For anything in this list which will not be completed, please provide a reason in the MR discussion.

Required

  • Merge Request Title and Description are up to date, accurate, and descriptive
  • MR targeting the appropriate branch
  • MR has a green pipeline on GitLab.com

Expected (please provide an explanation if not completing)

  • Test plan indicating conditions for success has been posted and passes
  • Documentation created/updated
  • Tests added
  • Integration tests added to GitLab QA
  • Equivalent MR/issue for omnibus-gitlab opened

(Only documentation changed)

Edited by Blake Burkhart

Merge request reports