Skip to content

Add S3 Authentication

Marios Hadjimichael requested to merge mhadjimichael/buildgrid:marios/add-s3-auth into master

Description

This MR adds authentication support for the S3 storage backend.

More specifically, it:

  • Introduces the access_key and secret_key options in the configuration file for s3 and uses those to talk to S3 servers.
  • Fixes an issue with reads from S3 since the initial StreamingBody object that was returned is not seekable. (we construct a io.BytesIO() object out of the contents of the S3 StreamingBody).

For reference, the storages section of the config should look similar to:

storages:
    - !s3-storage &data-store
      bucket: my-bucket
      endpoint: http://1.2.3.4:5678
      access_key: my-access-key
      secret_key: my-secret-key

Merge request reports