Skip to content

Add the option to run documentation tool on vertex embeddings

Alexandru Croitor requested to merge use_vertex_embeddings_with_ai_documentation_tool into master

What does this MR do and why?

Add the option to run documentation tool on vertex embeddings

With this change behind use_embeddings_with_vertex FF, we can let documentation tool use vertex embeddings to search for relevant pieced of documentation.

Screenshots or screen recordings

Screenshots are required for UI changes, and strongly recommended for all other merge requests.

Before After

How to set up and validate locally

  • Make sure you have OpenAI and VertexAi embeddings populated.
    • OpenAI embeddings: rake gitlab:llm:embeddings:seed_pre_generated
    • VertexAI embeddings: rake gitlab:llm:embeddings:vertex:seed
  • Toggle use_embeddings_with_vertex FF
  • Try asking documentation questions in GitLab Duo with FF on and off. E.g. how to change password.
  • In llm.log you should be able to see if we are making calls to OpenAi or VertexAI depending on the FF state

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Alexandru Croitor

Merge request reports