Skip to content

Set Triton replicas to 4

Alexander Chueshev requested to merge triton-replicas-4 into main

After introducing dynamic batching in !131 (merged), we set Triton replicas to 4.

cc @tle_gitlab @andrewn

Merge request reports