Vulnerability Resolution AI Gateway Integration

Summary

Vulnerability Resolution needs to be integrated with the AI Gateway as part of our efforts to separate our direct GitLab code from the specific AI providers.

Blocker

At time of issue writing, the AI Gateway does not currently support Vertex, making this migration impossible. Once Vertex is supported, the migration should be straightforward due to the model agnostic writing of the AiGateway client class in GitLab. workflowblocked by AI Gateway as the Sole Access Point for Monolit... (&13024) • Unassigned.

Update:

We're going to proceed with Anthropic per latest discussion with model validation team. But keep in mind:

We need the flexibility to change depending on the result of the model validation

Resources

Some materials for getting started with the Gateway:

• https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/blob/main/README.md?ref_type=heads
• https://gitlab.com/gitlab-org/modelops/applied-ml/code-suggestions/ai-assist/-/tree/main?ref_type=heads#local-development-using-gdk
• https://youtu.be/SXfLOYm4zS4

Implementation Plan

• Update the LLM Client for Vulnerability Resolution to use the new `AiGateway::Client` class.