Add claude-3
What does this merge request do and why?
This MR adds Claude-3 to the eval framework:
- Added
claude-3-opus
andclaude-3-sonnet
- Use the new message API
-
claude-2
andclaude-2.1
both points to claude-2.1 - Put claude API version as part of
ModelMeta
Ref: #178 (closed), #180
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
Merge request checklist
-
I've ran the affected pipeline(s) to validate that nothing is broken. https://console.cloud.google.com/bigquery?authuser=0&project=dev-ai-research-0e2f8974&ws=!1m5!1m4!4m3!1sdev-ai-research-0e2f8974!2sduo_chat_experiments!3shyang_delme_20240305_150413__similarity_score -
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
This is in reference to : https://gitlab.com/gitlab-org/modelops/ai-model-validation-and-research/ai-evaluation/prompt-library/-/issues/180
Edited by Hongtao Yang