Catch Vertex API InvalidArgument error (!221) · Merge requests · GitLab.org / ModelOps / AI Assisted (formerly Applied ML) / Code Suggestions / AI Gateway

Alexander Chueshev requested to merge catch-vertex-invalid-argument into main Jul 11, 2023

The Vertex API often returns error 400 for particular prefixes and suffixes that we cannot log due to legal. This MR catches error 400 and returns empty suggestions to avoid triggering error 500 on the model-gateway side.

Ref: https://gitlab.com/gitlab-com/gl-infra/reliability/-/issues/24038#note_1453195766

Catch Vertex API InvalidArgument error

Merge request reports