Skip to content

Add claude-3

Hongtao Yang requested to merge hyang/claude-3 into main

What does this merge request do and why?

This MR adds Claude-3 to the eval framework:

  • Added claude-3-opus and claude-3-sonnet
  • Use the new message API
  • claude-2 and claude-2.1 both points to claude-2.1
  • Put claude API version as part of ModelMeta

Ref: #178 (closed), #180

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

This is in reference to : https://gitlab.com/gitlab-org/modelops/ai-model-validation-and-research/ai-evaluation/prompt-library/-/issues/180

Edited by Hongtao Yang

Merge request reports