Skip to content

Update model concurrency limit variable in doc

Tan Le requested to merge doc-model-concurrency-inference-limit into main

What does this merge request do and why?

This MR updates model concurrency limit variable references in doc. This is to reflect the code changes implemented in !561 (merged).

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Tan Le

Merge request reports