Modify plan tools to use Claude 3
What does this MR do and why?
This MR aims at migrating all the existing Plan tooling to utilize the Claude 3 Haiku model. I'm not exactly sure what the basic for using the Haiku model, but evaluation testing has shown it's more performant with these tools.
The goal is a wider push to make sure we are migrating to Claude 3 as a collective org.
MR acceptance checklist
-
Ensure the following tools list in the MR work locally -
Make sure that the response format is coming in useful format.
Screenshots or screen recordings
Screenshots are required for UI changes, and strongly recommended for all other merge requests.
How to set up and validate locally
- In rails console enable the experiment fully
Feature.enable(:ai_claude_3_sonnet)
- Visit the following group that has Duo Enabled features such as
http://127.0.0.1:3000/test
- Ensure that following prompts are coming from Claude 3 generated results are coming with the following format
[
{"role": "user", "content": "Hello there."},
{"role": "assistant", "content": "Hi, I'm Claude. How can I help you?"},
{"role": "user", "content": "Can you explain LLMs in plain English?"},
]
Edited by Jessie Young