Create base prompt template for code completion with Anthropic

As we want to build an alternative for code completion based on Anthropic we need to start with a base template that supports taking current values and producing valid code insight, target is an output size similar as current code completion of 64-128 tokens? Have the possibility to add in the future more context to the prompt for instructions.

Current values:

  • File Path
  • Language
  • Prefix
  • Suffix

That prompt would then be provided to the model gateway by using a prompt attribute which already contains then the full pre-built prompt and selecting the model family of anthropic . Lets use XML tags if possible as this would also enable us to do a fall back transformation in the model gateway if ever needed.

Edited Sep 21, 2023 by Tim Zallmann
Assignee Loading
Time tracking Loading