Skip to content

chore: ai gateway image for self hosted deployment

What does this merge request do and why?

Facilitates setup of self-hosted models by creating an image that already includes all self-hosted related configs, including embedded docs, which were before generated on gitlab-rails.

How to set up and validate locally

  1. Build the docker image:

    docker build . -f docker/self_hosted/Dockerfile --build-arg='TAG=self-hosted-v17.3.0-ee' -t model-gateway:self-hosted-v17.3.0-ee
  2. Run the image

    docker run -p 50001:5052 model-gateway:self-hosted-v17.3.0-ee
  3. Query docs

    curl -X 'POST' \
      'http://localhost:50001/v1/search/gitlab-docs' \
      -H 'accept: application/json' \
      -H 'Content-Type: application/json' \
      -d '{
      "type": "string",
      "metadata": {
        "source": "string",
        "version": "string"
      },
      "payload": {
        "query": "issues",
        "page_size": 4
      }
    }'

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Eduardo Bonet

Merge request reports

Loading