Add optional prompt and model-family attributes and Anthropic Claude to code completion endpoint
Problem to solve
In the same way as we added for code generation an optional prompt attribute we want to do the same for 2 new attributes so the monolith can get its calls routed with pre-made informaiton.
Proposal
prompt
Optional, overrides any internal pre-processing for code completion
model-family
(feel free to find a better name)
Optionla, To specifically select a model family (we would still control the version in the model gateway)
Default is code-gecko
and claude
is possible.
If the model-family is claude we then need to route that call to Anthropic Claude https://docs.anthropic.com/claude/reference/getting-started-with-the-api. There is already an MR in progress to add anthropic as proxy endpoint to enable Chat - with which we need to coordinate - !383 (closed)
Further details
Links / references
Edited by Tim Zallmann