Update Claude to 2.1
Currently we are using Claude 2.0 for Duo Chat.
We can use New version of Claude: https://www.anthropic.com/index/claude-2-1
to do that, we need to:
- update templates to use system prompts structure per https://docs.anthropic.com/claude/docs/how-to-use-system-prompts
- we can update places when we are indicationg 100k window, like https://gitlab.com/gitlab-org/gitlab/-/blob/f4274cf106e689b95446fbcac04e8b881781bbe7/ee/lib/gitlab/llm/chain/concerns/anthropic_prompt.rb#L11-11
- then we need to run tests to check for accuracy of new schema.