Duo Chat: Extend AI Gateway to accept custom models params
Overview
In order to backup Duo Chat with a custom model, we need to extend the list of params with custom models information, like:
payload: {
content: prompt,
- provider: provider(options),
- model: model(options)
+ provider: 'litellm',
+ model: 'mistral',
+ model_endpoint: 'http://localhost:11434/v1',
+ model_api_key: 'api-key',
}.merge(payload_params(options))
But GitLab AI Gitway must support this type of params.
Proposal
Add support for custom models params in GitLab AI Gateway
Edited by Igor Drozdov