Prompt Routing in GitLab Rails
Currently each GitLab Duo feature has it's own prompt tailored to a specific model.
As we introduce new models, we will need specific prompts for each model. The prompts are currently baked into the GitLab Rails source code. https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools?ref_type=heads
A prompt router will need to be built to select the correct prompt from the source code.
Note
Code Suggestions already uses two different models, one for code completion and one for code generation. The prompt alignment occurs in Rails (here and here), depending on the use case (completion vs generation).
Edited by Sean Carroll