Skip to content

More language support for chunking functions.

Hongtao Yang requested to merge more-language-chunking into main

This MR adds support for more languages for chunking functions.

The current logic for current_block and current_context chunking functions is very general that should work with minimal changes for other languages.

This MR aims to add support for existing languages in the content_v1 BQ table

  • Rust: Works as is. Added tests in this MR.
  • GO: Should work with an additional function node type. Added tests in this MR.
  • c_sharp: added logic for finding the current context.
  • c: added logic for finding the declaration block.
  • ruby

Ref: https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/prompt-library/-/issues/22

Edited by Hongtao Yang

Merge request reports