Update config for running local AI Gateway
What does this MR do and why?
Update config for running local AI Gateway
- Previously, the recommendation was to set the URL in the database
- The database attribute is really meant for customers using self-hosted models. Most of the time, GitLab developers want to mimic the experience of GitLab customers using the "hosted" AI Gateway.
- The
CLOUD_CONNECTOR_BASE_URL
only works if the AIGW instance is available at the/ai
path, which is specific to Cloud Connector. - So now we are recommending a new ENV var for configuring this value.
References
- I am also updating AIGW setup instructions in GDK at gitlab-development-kit!5346
- see conversation in !204287 (closed)
How to set up and validate locally
- Set the
ENV
varDEVELOPMENT_AI_GATEWAY_URL
to your local AIGW - Make sure
AI_GATEWAY_URL
is unset andAi::Setting.instance.ai_gateway_url
isnil
- Restart AI Gateway
- Classic Duo Chat should still work
MR acceptance checklist
Evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.