After introducing dynamic batching in !131 (merged), we set Triton replicas to 4.
cc @tle_gitlab @andrewn