Issue a registry configuration update on production
Production Change - Criticality 3 C3
| Change Objective | upgrades the chart version which adds deployment annotations and the storage config block |
|---|---|
| Change Type | Type described above |
| Services Impacted | registry |
| Change Team Members | @jarv |
| Change Severity | C3 |
| Buddy check or tested in staging | @aamarsanaa |
| Schedule of the change | 07:20 UTC |
| Duration of the change | 10m |
| Detailed steps for the change. Each step must include: | - pre-conditions for execution of the step, - execution commands for the step, - post-execution validation for the step , - rollback of the step |
Opening this as a change issue since it is our first configuration update on production, this change upgrades the chart version which adds deployment annotations and the storage config block, a diff of the change can be seen here: https://ops.gitlab.net/gitlab-com/gl-infra/k8s-workloads/gitlab-com/-/jobs/622263
This is needed for https://gitlab.com/gitlab-com/gl-infra/infrastructure/issues/7662
The new health config adds a health check for the storage driver https://docs.docker.com/registry/configuration/#health. this is how we previously were configured when running on VMs.
apply
-
Run the deploy to production manual job https://ops.gitlab.net/gitlab-com/gl-infra/k8s-workloads/gitlab-com/pipelines/77571
monitoring
- Logs - https://log.gitlab.net/goto/43fb211edc754b58d4e22f3142eaeb8f
- Application Metrics: https://dashboards.gitlab.net/d/CoBSgj8iz/application-info
- Pod Metrics: https://dashboards.gitlab.net/d/oWe9aYxmk/pod-metrics
- Registry service error ratios - https://dashboards.gitlab.net/d/general-service/general-service-platform-metrics?orgId=1&var-type=registry&from=now-1h&to=now&fullscreen&panelId=8
- General service metrics, registry - https://dashboards.gitlab.net/d/general-service/general-service-platform-metrics?orgId=1&var-type=registry&from=now-1h&to=now
rollback
-
Revert gitlab-com/gl-infra/k8s-workloads/gitlab-com!51 (merged) and apply to production
Edited by John Jarvis