feat: add GPU saturation resources for code suggestions (!5883) · Merge requests · GitLab.com / Runbooks · GitLab

Chance Feick requested to merge feat/code-suggestions-gpu-saturation into master Jun 01, 2023

Add GPU saturation resources for code suggestions. Based on https://github.com/triton-inference-server/server/blob/main/docs/user_guide/metrics.md#gpu-metrics. For gitlab-org/modelops/applied-ml/code-suggestions/ai-assist#123 (moved).

Tasks

GPU Utilization
GPU Memory
GPU Power

Test Dashboard

https://dashboards.gitlab.net/dashboard/snapshot/k4CXTmYDqxRm3425Wzgnke2cWyFmMMRF?orgId=1

Edited Jun 03, 2023 by Chance Feick