This issue is to add Llama 3 support to Chat. The following models are to be prioritized, as supported by AWS GovCloud Bedrock and [customer requirements](https://gitlab.com/gitlab-org/product-feedback/-/issues/142): * [meta-llama/Meta-Llama-3-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) (supported on AWS GovCloud) * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) (supported on AWS GovCloud) * [~~meta-llama/Llama-3.1-8B-Instruct~~](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) * [~~Llama-3.1-70B-Instruct~~](https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct) * [meta-llama/Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) (supported by AWS Bedrock, Azure AI, vLLM, and customer) **Licenses** * [Llama 3 License](https://www.llama.com/llama3/license/) * [Llama 3.1 License](https://www.llama.com/llama3_1/license/) * [Llama 3.3 License](https://www.llama.com/llama3_3/license/) #### Use Cases Not every use case has a corresponding dataset for validation. For those that lack a dataset, anecdotal testing will be necessary to validate the prompt's functionality | Use Case | Dataset | |----------|---------| | [**Zero Shot Agent**](https://gitlab.com/gitlab-org/gitlab/-/blob/master/ee/lib/gitlab/llm/chain/agents/zero_shot/executor.rb) | N/A | | [**Code Generation**](https://gitlab.com/gitlab-org/gitlab/-/issues/474229) | :white_check_mark: | | [**EpicReader**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/epic_reader) / [**IssueReader**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/issue_reader) | :white_check_mark: | | [**GitlabDocumentation**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/gitlab_documentation) | :white_check_mark: | | [**Explain Code**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/explain_code) - **/explain** | :white_check_mark: | | [**RefactorCode**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/refactor_code) - **/refactor** | :x: | | [**FixCode**](https://gitlab.com/gitlab-org/gitlab/-/blob/master/ee/lib/gitlab/llm/chain/tools/fix_code/executor.rb) - **/fix** | :x: | | [**WriteTests**](https://gitlab.com/gitlab-org/gitlab/-/tree/master/ee/lib/gitlab/llm/chain/tools/write_tests) - **/test** | :x: | ###