feat: add GPU saturation resources for code suggestions
Add GPU saturation resources for code suggestions. Based on https://github.com/triton-inference-server/server/blob/main/docs/user_guide/metrics.md#gpu-metrics. For gitlab-org/modelops/applied-ml/code-suggestions/ai-assist#123 (moved).
Tasks
-
GPU Utilization -
GPU Memory -
GPU Power
Test Dashboard
https://dashboards.gitlab.net/dashboard/snapshot/k4CXTmYDqxRm3425Wzgnke2cWyFmMMRF?orgId=1
Edited by Chance Feick