Skip to content

Add documentation on inference limits

Bob Van Landuyt requested to merge bvl/inference-limit-docs into main

Add documentation on inference limits

This documents what the inference limits are, where and on what dashboards we can see them.

It also explains the different limits we have for Anthropic and Vertex.

In the case of Anthropic, it also shows how these limits need to be manually updated when models or limits change.

For #391 (closed)

Merge request reports