3K Hybrid backups on AWS - runbook and validation
Proposal
Create a runbook for successfully backing up and restoring a 3K Hybrid instance on AWS.
Scenario:
- Reference architecture: 3k Cloud Native Hybrid
- Platform: AWS
- PG data in RDS: 50GB
- Git data (3k implies in Gitaly Cluster): 100GB
- LFS data in object storage: 100GB
Test data types:
The test data should include what is described in the documentation https://docs.gitlab.com/ee/raketasks/backup_gitlab.html
- Database
- Attachments
- Git repositories data
- CI/CD job output logs
- CI/CD job artifacts
- LFS objects
Terraform states- Container Registry images
GitLab Pages content- Packages
- Snippets
- Group wikis
Blob data types such as LFS objects and attachments will be stored on Object storage. DB backup will be managed by AWS tools not by backup rake task.
Approach:
- Build the environment
- Create the test data
- Validate the backup is successfully restored
- Record RTO/RPO for reference
- Describe details of process followed to take backup and restore on a new host. Details of commands run and on which hosts/nodes.
Edited by Sampath Ranasinghe