Adding Service Monitor
This way prometheus will be able to scrape the application metrics published by triton.
This will also require prometheus to be deployed to the cluster. Fortunately that was handled yesterday.
https://gitlab.com/gitlab-org/modelops/applied-ml/ai-assist/ai-assist-api/-/issues/8#note_1181501903
Edited by Mon Ray