Skip to content

Quickfix: Convert Anthropic model name to string

Alexander Chueshev requested to merge ac/anthropic-model-name-str into main

What does this merge request do and why?

This MR converts the Anthropic model name to a string value. Issue: we need to restore the previous metric keys tracked by the ModelRequestInstrumentator and changed in !523 (diffs, comment 1704495590).

Discussion - https://gitlab.slack.com/archives/C048Z2DHWGP/p1703175210806649

Thanos - https://thanos-query.ops.gitlab.net/graph?g0.expr=sum%20by%20(model_name%2C%20model_engine)(max_over_time(model_inferences_in_flight%7Benv%3D%22gprd%22%2C%20model_engine%3D%22anthropic%22%7D%5B10m%5D))&g0.tab=0&g0.stacked=0&g0.range_input=2h&g0.max_source_resolution=0s&g0.deduplicate=1&g0.partial_response=0&g0.store_matches=%5B%5D

cc @reprazent

How to set up and validate locally

Please, check !523 (merged) for the detailed instructions.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Alexander Chueshev

Merge request reports