Geo: Validate Object storage replication using GCP based object storage
Build an GCP Geo Reference architecture using GET and record the time it takes to replicate items from one Geo site to another whilst using both GCP based replication and GitLab based replication.
Relates to #347314 (closed)
Designs
- Show closed items
Activity
-
Newest first Oldest first
-
Show all activity Show comments only Show history only
- Nick Westbury changed milestone to %14.8
changed milestone to %14.8
- Nick Westbury added Category:Disaster Recovery devopssystems groupgeo sectioncore platform + 1 deleted label
added Category:Disaster Recovery devopssystems groupgeo sectioncore platform + 1 deleted label
- Nick Westbury assigned to @nwestbury
assigned to @nwestbury
- Nick Westbury added to epic &5551 (closed)
added to epic &5551 (closed)
- Nick Westbury mentioned in issue #347314 (closed)
mentioned in issue #347314 (closed)
- Maintainer
@nwestbury, please can you add a type label to this issue to help with issue discovery in issue reports. - 🤖 GitLab Bot 🤖 added auto updated label
added auto updated label
- Fabian Zimmer added workflowready for development label
added workflowready for development label
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6331 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6331 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6425 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6425 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6496 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6496 (closed)
- 🤖 GitLab Bot 🤖 changed milestone to %14.9
changed milestone to %14.9
- 🤖 GitLab Bot 🤖 added missed:14.8 label
added missed:14.8 label
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6580 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6580 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6687 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6687 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6845 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6845 (closed)
- 🤖 GitLab Bot 🤖 changed milestone to %14.10
changed milestone to %14.10
- 🤖 GitLab Bot 🤖 added missed:14.9 label
added missed:14.9 label
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6911 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6911 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#6997 (closed)
mentioned in issue gitlab-org/quality/triage-reports#6997 (closed)
- 🤖 GitLab Bot 🤖 mentioned in issue gitlab-org/quality/triage-reports#7076 (closed)
mentioned in issue gitlab-org/quality/triage-reports#7076 (closed)
- Author Developer
Replication times for Geo managed replication in GCP
EU - EU Replication
Sending 1 request every 6 second(s) for 60 second(s) | Uploaded Artifact URL | Uploaded At | Replicated At | Duration | HTTP Status Code | |-----------------------|-------------|---------------|----------|------------------| | /gitlab-instance-a53c8ab5/test/uploads/5ba139abe6abbf06bd3a2b9124087908/keyboard.jpg | 12:39:12 | 12:39:20 | 8s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/96e0babead3e6711cfc953b45a7be425/keyboard.jpg | 12:39:18 | 12:39:24 | 6s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/07521ff4c5f5f9788828c31c16221e7b/keyboard.jpg | 12:39:24 | 12:39:30 | 6s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/9df575654473fff76d871e51719b937b/keyboard.jpg | 12:39:30 | 12:39:35 | 5s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/baedd802473815c49f5ac4df75a83186/keyboard.jpg | 12:39:36 | 12:39:42 | 6s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/2481fffe1539ae2c68e0dc95bd09288e/keyboard.jpg | 12:39:42 | 12:39:48 | 6s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/e7c816c60ac6e1e4b4d383d8077dbb40/keyboard.jpg | 12:39:48 | 12:39:56 | 8s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/0b081e4b1925682430213a8cc706ae1a/keyboard.jpg | 12:39:54 | 12:39:59 | 5s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/208adbfe0ea5292fcaa667c397151192/keyboard.jpg | 12:40:0 | 12:40:6 | 6s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/5e41170e5d38d4f09035e23276346639/keyboard.jpg | 12:40:6 | 12:40:13 | 7s | 200 | Fastest Replication: 5s Slowest Replication: 8s Average Replication: 6s
EU - US Replication
Sending 1 request every 6 second(s) for 60 second(s) | Uploaded Artifact URL | Uploaded At | Replicated At | Duration | HTTP Status Code | |-----------------------|-------------|---------------|----------|------------------| | /gitlab-instance-a53c8ab5/test/uploads/708650ec9093105304dfb4869e612445/keyboard.jpg | 12:40:58 | 12:41:6 | 8s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/6ee12c94293f3bfc0776ba9ff653a8d3/keyboard.jpg | 12:41:4 | 12:41:13 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/9e4e07801f949db1ce0bc52c6a0bdcdb/keyboard.jpg | 12:41:10 | 12:41:19 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/42f93e98b0ed109c7c59af23a63513bf/keyboard.jpg | 12:41:16 | 12:41:25 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/757e9727c59a696687eb75b317bf64dc/keyboard.jpg | 12:41:22 | 12:41:31 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/76063ce6ca50e21dcb38646299dad2b4/keyboard.jpg | 12:41:28 | 12:41:38 | 10s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/c9886ced69f24a40f1ca82b0c42ca74d/keyboard.jpg | 12:41:34 | 12:41:44 | 10s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/a8d4a8a185cc816e4f45c6d0c85f69fc/keyboard.jpg | 12:41:40 | 12:41:49 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/371c7194a6fb8182550c0f52a512e6e3/keyboard.jpg | 12:41:46 | 12:41:55 | 9s | 200 | | /gitlab-instance-a53c8ab5/test/uploads/e28ee234036113555a2fc0f3d3850191/keyboard.jpg | 12:41:52 | 12:42:2 | 10s | 200 | Fastest Replication: 8s Slowest Replication: 10s Average Replication: 9s
Edited by Nick Westbury - Nick Westbury marked this issue as related to #358152 (closed)
marked this issue as related to #358152 (closed)
- Nick Westbury marked this issue as related to #358154 (closed)
marked this issue as related to #358154 (closed)
- Nick Westbury added workflowin review label and removed workflowready for development label
added workflowin review label and removed workflowready for development label
- Author Developer
Looking into GCP managed replication and this doesn't really seem possible to test. GCP doesn't handle bucket replication like other cloud providers. GCP doesn't allow you to create separate buckets where one replicates from the other. When creating a bucket in GCP you choose if you want it to be multi, duel or single region. This means the bucket will be geo located in each region and assumably GCP will route you to the closest bucket. However the regions used are pre selected by GCP and are not cross continent.
1 - Author Developer
@fzimmer / @mkozono , I've tested this now for Geo managed replication and have posted the results above. The replication times for same region and cross region are both pretty good. However as mentioned above it doesn't seem possible to easily test the GCP managed replication due to the restriction with how GCP handles replication.
Collapse replies - Developer
Thanks. This looks great. Based on your results I don't see any performance concerns with Geo-managed replication. Do you both agree @nwestbury @mkozono?
- Author Developer
Across all 3 tested cloud providers, Geo managed replication has remained pretty consistent with same region replication taking about 5 seconds, the only mild concern is in AWS where cross region took closer to 33 seconds, but this was still quicker then some cloud provider times. So overall no concerns with performance, but maybe some areas to investigate more.
- Author Developer
I've also raised !84622 (merged) to update the testing docs for these results.
- Maintainer
Yes, these are great results IMO. Thanks @nwestbury! I intend to review !84622 (merged) tomorrow.
- Michael Kozono removed the relation with #358152 (closed)
removed the relation with #358152 (closed)
- Michael Kozono mentioned in merge request !84622 (merged)
mentioned in merge request !84622 (merged)
- Michael Kozono closed
closed
- Michael Kozono removed 1 deleted label
removed 1 deleted label
- Vincy Wilson mentioned in work item #347314 (closed)
mentioned in work item #347314 (closed)
- Suzanne Selhorn mentioned in merge request gitlab-docs!3607 (closed)
mentioned in merge request gitlab-docs!3607 (closed)