Code Suggestions Engineering Improvements
# Overview Till 22nd May : Milestone Planning: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/89 Reference: [Open Beta Epic](https://gitlab.com/groups/gitlab-org/modelops/applied-ml/code-suggestions/-/epics/3) # Functionality #### Infrastructure Support Tasks Support that is needed by teams in the Infrastructure department will be collected under https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/996+ #### Observability and Scalability 1. [x] Scalability: Adding Load Generation Scripts: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/77+ 1. [x] Observability: GPU Usage - https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/23786+ 1. [x] Obersevability: Application logs: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/65 1. [x] Observability: Alerting: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/87 1. [x] Scalability: Setting up Staging Environment: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/78+ (moved to Infra Epic) 1. [x] Scalability: Handling requests: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/81+ 1. [x] Observability: Ingesting Prometheus Metrics for production cluster: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/issues/79+ cc @tmccaslin , @nkhalwadekar , @wayne, @hbenson
epic