Skip to content

Use different models for explain code

Gosia Ksionek requested to merge mk-test-different-models into master

What does this MR do and why?

This MR changes model for Explain Code part of the chat to the newest, more code-specialized claude 2.

Screenshots or screen recordings

diff of rake task output: https://www.diffchecker.com/UAYk22vE/

How to set up and validate locally

  1. Run rake task on this branch and on master and compare results. For quicker run time, you can comment out non-code questions in https://gitlab.com/gitlab-org/gitlab/blob/de6edd992eb73793b4e55c2e87bd414c7fbdf10d/ee/lib/tasks/gitlab/llm/questions.yml#L24-24.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Gosia Ksionek

Merge request reports