fix: reduce gitlab_blob_search tool description size

What does this merge request do and why?

Part of duo workflow service tool rework #1602, this MR achieves 10X (from 3409 to 363) reduction the character size of gitlab_blob_search tool description while keep the same input schema and routing performance.

It also removes the instruction that is only available for advanced or zoekt search mode to avoid confuse llm tries search feature that is not supported in the instance / group/ projects. As the availability of advanced or zoekt search mode depends on the admin configuration on instance and group levels.

Big thanks from search team @dgruzd for the input. slack thread

Evaluation is ran on 3 examples tailored for gitlab_blob_search tool, each example is run repetitively 5 times to validate the tool_name and input arg values.

How to set up and validate locally

Routing evaluation code is on my local setup, will create a MR once available. For the validation purpose for this MR, I think the evaluation result is enough given that tool description is not evaluated systematically before.

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
  • If this change requires executor implementation: verified that issues/MRs exist for both Go executor and Node executor or confirmed that changes are backward-compatible and don't break existing executor functionality.
Edited by Junming Huang

Merge request reports

Loading