Resolve "Include AI Gateway in GDK"
What does this merge request do and why?
This MR adds support for installing, updating and running the GitLab AI Gateway, using the steps documented at https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/blob/main/README.md#how-to-run-the-server-locally.
cc @dsatcher, @andr3, @oregand
How to set up and validate locally
- Check out this branch,
2025-include-ai-gateway-in-gdk-2
- Stop your GDK
- Run
gdk config set gitlab_ai_gateway.enabled true
- Run
make Procfile gitlab-ai-gateway-setup
, ensuring your watch the output and verify your Google Cloud login - You can also run
make gitlab-ai-gateway-update
as well to ensure this works - Now run either
gdk start gitlab-ai-gateway
or justgdk start
- You can watch the status of the service by running
gdk tail gitlab-ai-gateway
- Once you see something along the lines of
"Application startup complete."
in the gdk tail gitlab-ai-gateway` output, you should be able to hit http://localhost:5052/docs and see the AI Gateway running - Also confirm that running
gdk status
prints=> GitLab AI Gateway is available at http://localhost:5052.
at the bottom of its output.
You could also create a new GDK instance using the 2025-include-ai-gateway-in-gdk-2
branch with the same steps to ensure everything works from scratch:
cd /tmp
git clone git@gitlab.com:gitlab-org/gitlab-development-kit.git
cd gitlab-development-kit
git checkout 2025-include-ai-gateway-in-gdk-2
make bootstrap
gdk config set gitlab_ai_gateway.enabled true
make install
- Verify using the same steps earlier
Impacted categories
The following categories relate to this merge request:
-
gdk-reliability - e.g. When a GDK action fails to complete. -
gdk-usability - e.g. Improvements or suggestions around how the GDK functions. -
gdk-performance - e.g. When a GDK action is slow or times out.
Merge request checklist
-
This change is backward compatible. If not, please include steps to communicate to our users. -
Tests added for new functionality. If not, please raise an issue to follow-up. -
Documentation added/updated, if needed. -
Announcement added, if change is notable. -
gdk doctor
test added, if needed. -
Add the ~highlight
label if this MR should be included in theCHANGELOG.md
.
Closes #2025 (closed)
Edited by Ash McKenzie