Skip to content

Resolve "Include AI Gateway in GDK"

Ash McKenzie requested to merge 2025-include-ai-gateway-in-gdk-2 into main

What does this merge request do and why?

This MR adds support for installing, updating and running the GitLab AI Gateway, using the steps documented at https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/blob/main/README.md#how-to-run-the-server-locally.

cc @dsatcher, @andr3, @oregand

How to set up and validate locally

  1. Check out this branch, 2025-include-ai-gateway-in-gdk-2
  2. Stop your GDK
  3. Run gdk config set gitlab_ai_gateway.enabled true
  4. Run make Procfile gitlab-ai-gateway-setup, ensuring your watch the output and verify your Google Cloud login
  5. You can also run make gitlab-ai-gateway-update as well to ensure this works
  6. Now run either gdk start gitlab-ai-gateway or just gdk start
  7. You can watch the status of the service by running gdk tail gitlab-ai-gateway
  8. Once you see something along the lines of "Application startup complete." in the gdk tail gitlab-ai-gateway` output, you should be able to hit http://localhost:5052/docs and see the AI Gateway running
  9. Also confirm that running gdk status prints => GitLab AI Gateway is available at http://localhost:5052. at the bottom of its output.

You could also create a new GDK instance using the 2025-include-ai-gateway-in-gdk-2 branch with the same steps to ensure everything works from scratch:

  1. cd /tmp
  2. git clone git@gitlab.com:gitlab-org/gitlab-development-kit.git
  3. cd gitlab-development-kit
  4. git checkout 2025-include-ai-gateway-in-gdk-2
  5. make bootstrap
  6. gdk config set gitlab_ai_gateway.enabled true
  7. make install
  8. Verify using the same steps earlier

Impacted categories

The following categories relate to this merge request:

Merge request checklist

  • This change is backward compatible. If not, please include steps to communicate to our users.
  • Tests added for new functionality. If not, please raise an issue to follow-up.
  • Documentation added/updated, if needed.
  • Announcement added, if change is notable.
  • gdk doctor test added, if needed.
  • Add the ~highlight label if this MR should be included in the CHANGELOG.md.

Closes #2025 (closed)

Edited by Ash McKenzie

Merge request reports