3K Hybrid backups on AWS - runbook and validation

Proposal

Create a runbook for successfully backing up and restoring a 3K Hybrid instance on AWS.

Scenario:

• Reference architecture: 3k Cloud Native Hybrid
• Platform: AWS
• PG data in RDS: 50GB
• Git data (3k implies in Gitaly Cluster): 100GB
• LFS data in object storage: 100GB

Test data types:

The test data should include what is described in the documentation https://docs.gitlab.com/ee/raketasks/backup_gitlab.html

• Database
• Attachments
• Git repositories data
• CI/CD job output logs
• CI/CD job artifacts
• LFS objects
• Terraform states
• Container Registry images
• GitLab Pages content
• Packages
• Snippets
• Group wikis

Blob data types such as LFS objects and attachments will be stored on Object storage. DB backup will be managed by AWS tools not by backup rake task.

Approach:

• Build the environment
• Create the test data
• Validate the backup is successfully restored
• Record RTO/RPO for reference
• Describe details of process followed to take backup and restore on a new host. Details of commands run and on which hosts/nodes.