Skip to content

Add option for a path prefix string for s3 object

Neill Whillans requested to merge neill/s3_name_prefixes into master

Before raising this MR, consider whether the following are required, and complete if so:

  • Unit tests
  • Metrics
  • Documentation update(s)

If not required, please explain in brief why not.

Description

This requests aims to provide a configuration option for S3 storage, for a path prefix string for the s3 objects. It can be used on it's own, or in conjunction with the existing hash prefix option.

Changes proposed in this merge request:

  • Update parser and storage scheme for S3 storage, to provide additional config option
  • Update construction/deconstruction of S3 key, to support none, or a combination of the two prefix types (string/hash)
  • Updated unit tests to confirm functionality of construction/deconstruction

Validation

Please note steps the reviewer should take to be able to test this MR; any necessary setup they might need, what results they should be looking for to verify.

Issues addressed

Closes / Resolves / Addresses (delete as appropriate) issue <e.g. repo-name#x>

Merge request reports