Skip to content

Migrate Artifacts from S3 to GCS

We need to migrate artifact object storage from S3 to GCS. This has the added benefit of allowing direct_upload of artifacts. Much of the work of this has already been done. We sync the GCS bucket with S3 daily so everything is kept up do date. The process for completing the migration should be as follows:

  • Disable direct_upload of artifacts
  • Run a final sync between S3 and GCS of the artifacts bucket
  • Change storage location in gitlab.rb to point to GCS
  • Verify artifacts still work
  • Enable direct_upload of artifacts once more
  • migrate the artifacts that landed on disk to object storage

cc/ @ayufan @jarv @dosuken123

Edited by Alex Hanselka