Skip to content

feat: self-hosted model metadata

What does this merge request do and why?

Related epic: BE Enablement: Groundwork for Model Selection f... (gitlab-org&18583 - closed)

This MR intercepts grpc request and reads the x-gitlab-self-hosted-models-metadata header from Rails. The header contains self-hosted model metadata that should be used when a request is performed to LLM.

Edited by Igor Drozdov

Merge request reports

Loading