Skip to content

S3 cache can config arbitrary endpoints or enable S3 Transfer Acceleration endpoint

Gabriel Mazetto requested to merge s3-transfer-acceleration into omnibus-5-4-0

This change added two new configuration options to Omnibus:

  • s3_endpoint- you can point to any non-standard S3 compatible endpoint (ex: hosted MinIO)
  • s3_acceleration - define to true and let the AWS-SDK generate the correct URL to use S3 Transfer Acceleration

We rely on aws-sdk for most of the work, except for the S3 Transfer Acceleration URL generation. I've tried passing the use_accelerate_endpoint: true but it does not change the generated public_url for a combination of bucket and object. To overcome the limitation, I'm explicitly changing the endpoint to use the correct: s3-accelerate.amazonaws.com host.

This would normally be a bad idea, as the S3 accelerate endpoint does not support all actions, but as we only use the supported ones, this is a safe change.

Closes omnibus-gitlab#1724 (closed)

Merge request reports