Skip to content

Draft: Handle vertex AI credentials more gracefully

Matthias Käppler requested to merge mk-dont-require-vertex-ai into main
  • Allow them to not be set, in which case we skip init and log a warning
  • Support setting credentials in docker-compose

Currently, the model gateway crashes immediately unless GOOGLE_VERTEX_AI_CREDENTIALS is set to a valid credentials file. This puts up an unnecessary barrier to development and receiving contributions. I would like us to move to a development approach that makes this system more accessible to a wider range of contributors. We should not require to have Cloud Provider configs set up when developing locally. Sometimes all you want to test is a change to logging (or something similarly benign), which does not involve talking to Vertex AI or any other remote service.

Edited by Matthias Käppler

Merge request reports