Send platform (OS) information in prompt
Problem
Now that we are supporting container-less mode for Duo Workflow, we need a way to tell the LLM which platform we are running on (windows/mac/linux) so that the model can generate platform specific commands.
Desired Outcome
Pass OS to the workflow and include it in the prompt so that Workflow can derive which commands to invoke.
Proposed Implementation
- Executor fetch current OS information before sending
StartWorkflowRequest - Executor include OS information into
StartWorkflowRequestadding new entry intoAdditionalContextfield - Service is going to pick up this new entry at
grpc_server.pyand pass it intoWorkflowclass viacontext_elementsarguments - Add new optional metafield
<os_information>into agents prompts at https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/blob/05693c1a466eca54986bdf216b5480a7f821097f/duo_workflow_service/agents/prompts.py#L205, this new field should be optional and only amended to the prompts whenAdditionalContextwith OS data is present
Edited by Mikołaj Wawrzyniak