Skip to content

Server-side backups: Add ability to configure object-storage part size

S3 multi-part uploads have a limit on the number of parts that can be used for a single upload (10000) and a configurable size of these parts (default 5MB). This means that with the default configuration the maximum file size of a backup bundle (or any backup file) is about 50GB. See https://docs.aws.amazon.com/AmazonS3/latest/userguide/qfacts.html

Since the part size is easily configurable in gocloud via https://pkg.go.dev/gocloud.dev/blob?utm_source=godoc#WriterOptions we should expose this as an option to users so that larger backups could be supported.

Edited by James Fargher
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information