Skip to content
GitLab
Next
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • omnibus-gitlab omnibus-gitlab
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 1,059
    • Issues 1,059
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 53
    • Merge requests 53
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Code review
    • Insights
    • Issue
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • GitLab.orgGitLab.org
  • omnibus-gitlabomnibus-gitlab
  • Merge requests
  • !4368

Support consolidated object storage configuration

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Stan Hu requested to merge sh-support-consolidated-object-store-settings into master Jun 27, 2020
  • Overview 26
  • Commits 1
  • Pipelines 10
  • Changes 9

This adds support for the gitlab.yml changes in gitlab!34460 (merged). This allows GitLab to use the Workhorse S3 client with a single credential, enabling proper MD5 checksums and multipart uploads, and paves the way for user-specified keys for encrypted buckets.

These changes require gitlab!35480 (merged) to work.

  • Closes #5263 (closed)
  • Closes #5447 (closed)
  • Closes gitlab-workhorse#222 (closed)
  • Closes gitlab-workhorse#210 (closed)

Testing Matrix

Object store provider Pass?
AWS S3 ✅
Oracle Cloud S3 ✅
Digital Ocean Spaces ✅
OpenStack Swift ✅

Example config

gitlab_rails['object_store']['enabled'] =  true
gitlab_rails['object_store']['connection'] = {
  'provider' => 'AWS',
  'region' => 'ams3',
  'aws_access_key_id' => 'REDACTED',
  'aws_secret_access_key' => 'REDACTED',
  'endpoint' => 'https://ams3.digitaloceanspaces.com',
}

gitlab_rails['object_store']['proxy_download'] = false
gitlab_rails['object_store']['objects']['artifacts']['bucket'] = 'stanhu-artifacts'
gitlab_rails['object_store']['objects']['external_diffs']['bucket'] = 'stanhu-external-diffs'
gitlab_rails['object_store']['objects']['lfs']['bucket'] = 'stanhu-lfs'
gitlab_rails['object_store']['objects']['uploads']['bucket'] = 'stanhu-uploads'
gitlab_rails['object_store']['objects']['packages']['bucket'] = 'stanhu-packages'
gitlab_rails['object_store']['objects']['dependency_proxy']['bucket'] = 'stanhu-dependency-proxy'
gitlab_rails['object_store']['objects']['terraform_state']['bucket'] = 'stanhu-terraform-state'
Edited Jul 03, 2020 by Stan Hu
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: sh-support-consolidated-object-store-settings