feat: register error for the failed litellm streams (!779) · Merge requests · GitLab.org / ModelOps / AI Assisted (formerly Applied ML) / Code Suggestions / AI Gateway · GitLab

Igor Drozdov requested to merge id-error-instrumentation-for-litellm into main May 02, 2024

What does this merge request do and why?

Within Add LiteLLM client to handle requests to self-m... (!742 - merged), the support for litellm requests has been added. This merge request is a follow-up to register error when a streamed response fails.

Related issue: Instrument errors in LiteLLM models (#451 - closed)

Edited May 02, 2024 by Igor Drozdov