1K Omnibus backups on GCP - runbook and validation

Proposal

Create a runbook for successfully backing up and restoring a 1K Omnibus instance on GCP.

Scenario:

  • Reference architecture: 1k Omnibus
  • Platform: GCP
  • PG data: 15GB
  • Git data: 30GB
  • LFS data: 30GB
  • Backup during maintenance window

Test data types:

The test data should include what is described in the documentation https://docs.gitlab.com/ee/raketasks/backup_gitlab.html

  • Database
  • Attachments
  • Git repositories data
  • CI/CD job output logs
  • CI/CD job artifacts
  • LFS objects
  • Terraform states
  • Container Registry images
  • GitLab Pages content
  • Packages
  • Snippets
  • Group wikis

All blob type data uses local storage as opposed to object storage

Approach:

  • Build the environment
  • Create the test data
  • Validate the backup is successfully restored
  • Record RTO/RPO for reference
  • Describe details of process followed to take backup and restore on a new host. Details of commands run and on which hosts/nodes.
Edited by Sampath Ranasinghe