## Problem Statement Delivery's OKR is to migrate GitLab.com to Kubernetes. This Epic captures and isolates all sidekiq workers that prevent completing the migration of Sidekiq into Kubernetes. Utilize this Epic to keep track of each worker and ensure we have issues to address the necessary work to migrate these workers into Kubernetes as the blocking situation is fixed. ## Status 2021-06-28 The final work of queue movements is happening in https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/447 Therefore this epic can be closed. The documentation epic has been moved. ## Status 2021-03-20 * Pages NFS has been decommissioned, all that remains is to migrate the remaining workers on VMs to K8s. This is currently ~blocked by https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/447 based on the concerns in https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-com/-/merge_requests/867#note_580309976 ## Status 2020-03-10 * Ramping work back up * Starting the evaluation of the remaining queues https://gitlab.com/gitlab-com/gl-infra/delivery/-/issues/1599 ## Blockers This epic is blocked by https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/447 due to concerns about Redis saturation when moving the remaining queues. See https://gitlab.com/gitlab-com/gl-infra/k8s-workloads/gitlab-com/-/merge_requests/867#note_580309976 for details. ] ## Closed Blockers These items have been worked on and should no longer be blocking the sidekiq migration | Sidekiq Queue | Issue | Potential Dependency | Group | | --- | --- | --- | --- | | `group_destroy` | https://gitlab.com/gitlab-org/gitlab/-/issues/258650 | [GitLab Pages Architecture](https://gitlab.com/groups/gitlab-org/-/epics/1316) | Access | | `pages` | https://gitlab.com/gitlab-org/gitlab/-/issues/249830 | [GitLab Pages Architecture](https://gitlab.com/groups/gitlab-org/-/epics/1316) | Release Mgmt | | `pages_domain_ssl_renewal` | https://gitlab.com/gitlab-org/gitlab/-/issues/249832 | [GitLab Pages Architecture](https://gitlab.com/groups/gitlab-org/-/epics/1316) | Release Mgmt | | `pages_domain_verification` | https://gitlab.com/gitlab-org/gitlab/-/issues/249833 | [GitLab Pages Architecture](https://gitlab.com/groups/gitlab-org/-/epics/1316) | Release Mgmt | | `project_destroy` | https://gitlab.com/gitlab-org/gitlab/-/issues/249834 | [GitLab Pages Architecture](https://gitlab.com/groups/gitlab-org/-/epics/1316) | Source Code | | `mailers` | https://gitlab.com/gitlab-org/gitlab/-/issues/247117 | | | | `security_scans:store_security_reports` | https://gitlab.com/gitlab-org/gitlab/-/issues/249835 | TBD | ~"group::threat insights" | | `security_scans:store_security_scans` | https://gitlab.com/gitlab-org/gitlab/-/issues/249837 | TBD | ~"group::threat insights" | | `expire_build_instance_artifacts` | https://gitlab.com/gitlab-org/gitlab/-/issues/249824 | TBD | CI | | `requirements_management_process_requirements_reports` | https://gitlab.com/gitlab-org/gitlab/-/issues/249818 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | Certify | | `chat_notification` | https://gitlab.com/gitlab-org/gitlab/-/issues/249820 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | Configure | | `pipeline_background:archive_trace` | https://gitlab.com/gitlab-org/gitlab/-/issues/249825 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | CI | | `pipeline_background:ci_build_report_result` | https://gitlab.com/gitlab-org/gitlab/-/issues/249826 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | CI | | `pipeline_default:build_coverage` | https://gitlab.com/gitlab-org/gitlab/-/issues/249827 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | CI | | `pipeline_default:build_trace_sections` | https://gitlab.com/gitlab-org/gitlab/-/issues/249828 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | CI | | `pipeline_processing:build_finished` | https://gitlab.com/gitlab-org/gitlab/-/issues/249829 | [Cloud Job Logs](https://gitlab.com/groups/gitlab-org/-/epics/4275) | CI | ## Issue Board https://gitlab.com/groups/gitlab-com/gl-infra/-/boards/1888859?&label_name[]=Service%3A%3ASidekiq&label_name[]=kubernetes&label_name[]=sidekiq_shard%3A%3ACatchAll Milestones: * [ ] Complete next evaluation * [ ] Removed NFS from sidekiq VMs * [ ] All sidekiq VM's are removed from our infrastructure Use the following set of labels for all issues related to this queue migration: ``` /label ~"Service::Sidekiq" ~kubernetes ~"team::Delivery" ~"workflow-infra::Triage" ~"sidekiq_shard::CatchAll" /epic &276 ```