Skip to content

Add AI-gateway architecture blueprint

Add AI-gateway architecture blueprint

This moves the AI-gateway architecture that was discussed in gitlab-com/gl-infra/readiness!166 (merged) to the main repository for visibility. It started in the readiness document as a simple braindump, but then the discussion happened there so we decided to continue it there.

But now that the first iteration has been accepted, we think it might be more accessible for all stakeholders as an architecture blueprint. I'll make sure to crosslink the old location to this one if this has been accepted.

It doesn't follow the exact template of a blueprint, but does contain all of the information. I changed some of the titles to match and added a link to the issue where we discussed alternatives. The rest is from the original MR.

From https://about.gitlab.com/handbook/engineering/architecture/workflow/#do-i-need-to-use-architecture-design-workflow, I think it meets the following criteria to fit in a blueprint:

  • requires coordination across multiple functions
  • could impact overall system stability
  • requires more implementation time than two milestones
  • introduce special handling across distributions and deployments
  • adds a new service outside of the rails monolith, or an additional data source.
Edited by Bob Van Landuyt

Merge request reports