Move version app to new KAS based auto devops cluster and deployments
The current design app is running on an old cluster which was set up to be a generic PAAS for multiple applications using the old Certificate based Kubernetes integrations for Auto Devops. This cluster was never used for more than one app, and now the Certificate based Kubernetes integrations are being deprecated with GitLab 15.x.
Additionally, Google has changed their API enough that the Terraform code that we used to stand up the cluster cannot be made to work without major structural changes.
Although we have a workaround to force the Auto Devops deployments to keep working through the GitLab 15.x update, the best solution is to create a new cluster dedicated to this application and set it up properly using KAS deployments from the beginning.
We need to keep some older issues in mind while doing this work:
- Need to make sure that the Ingress has multiple pods running so we don't have this issue come back: https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/13904
- We will end up with a new version of nginx, addressing some of: https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/14275
- We need to make sure that the k8s version we are using uses
containerdhttps://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/15089 - If we move the project and repository, we should also consider making it public to address this issue: https://gitlab.com/gitlab-org/gitlab/-/issues/363564