S3 cache can config arbitrary endpoints or enable S3 Transfer Acceleration endpoint
This change added two new configuration options to Omnibus:
-
s3_endpoint
- you can point to any non-standard S3 compatible endpoint (ex: hosted MinIO) -
s3_acceleration
- define totrue
and let the AWS-SDK generate the correct URL to use S3 Transfer Acceleration
We rely on aws-sdk
for most of the work, except for the S3 Transfer Acceleration URL generation. I've tried passing the use_accelerate_endpoint: true
but it does not change the generated public_url
for a combination of bucket
and object
. To overcome the limitation, I'm explicitly changing the endpoint
to use the correct: s3-accelerate.amazonaws.com
host.
This would normally be a bad idea, as the S3 accelerate endpoint does not support all actions, but as we only use the supported ones, this is a safe change.
Closes omnibus-gitlab#1724 (closed)