Code Suggestions Engineering Improvements
# Overview
Till 22nd May : Milestone Planning: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/89
Reference: [Open Beta Epic](https://gitlab.com/groups/gitlab-org/modelops/applied-ml/code-suggestions/-/epics/3)
# Functionality
#### Infrastructure Support Tasks
Support that is needed by teams in the Infrastructure department will be collected under https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/996+
#### Observability and Scalability
1. [x] Scalability: Adding Load Generation Scripts: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/77+
1. [x] Observability: GPU Usage - https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/23786+
1. [x] Obersevability: Application logs: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/65
1. [x] Observability: Alerting: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/87
1. [x] Scalability: Setting up Staging Environment: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/78+ (moved to Infra Epic)
1. [x] Scalability: Handling requests: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/81+
1. [x] Observability: Ingesting Prometheus Metrics for production cluster: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/79+
cc @tmccaslin , @nkhalwadekar , @wayne, @hbenson
epic