Skip to content

feat: fixes self-provided claude_3 prompt

Eduardo Bonet requested to merge claude_3_generations_v2 into main

What does this merge request do and why?

feat: fixes self-provided claude_3 prompt

The generations prompt for claude_3 now matches other prompts for self-hosted models, like mistral

How to set up and validate locally

On .env

AWS_ACCESS_KEY_ID=<value>
AWS_SECRET_ACCESS_KEY=<value>
AWS_REGION_NAME="eu-central-1"

curl -X 'POST' \
  'http://localhost:5052/v2/code/generations' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "project_path": "string",
  "project_id": 0,
  "current_file": {
    "file_name": "Benchmark Questions Verification V2.ipynb",
    "language_identifier": "",
    "content_above_cursor": "Write a function to find the lateral surface area of a cube given its side length.",
    "content_below_cursor": ""
  },
  "model_provider": "litellm",
  "model_endpoint": "http://test.com",
  "model_api_key": "something",
  "model_identifier": "bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0",
  "model_name": "claude_3",
  "telemetry": [],
  "stream": false,
  "choices_count": 0,
  "context": [],
  "prompt_id": "code_suggestions/generations",
  "prompt_version": 2,
  "prompt": ""
}'

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Eduardo Bonet

Merge request reports

Loading