Skip to content

Refactor: Move model instrumentator to the engine class

Alexander Chueshev requested to merge move-model-telemetry into main

This MR moves the model instrumentator TextGenModelInstrumentator one level up to the engine ModelEnginePalm. It doesn't affect the existing monitoring logic however, we become more flexible in adding new fields to track or to catch exceptions better.

Merge request reports