feat: adds script to test a models TPS
What does this merge request do and why?
Adds a script to compute the TPS of a model deployed at an endpoint. This is useful to develop documentation and for users to quickly test the connection a to a model.
How to set up and validate locally
poetry run compute-tps --model-identifier <model-identifier> --model-endpoint <model-endpoint> --api-key <api-key> --requests 1
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Merge request reports
Activity
added groupai framework label
assigned to @eduardobonet
added devopsai-powered sectiondata-science labels
Reviewer roulette
To spread load more evenly across eligible reviewers, Danger has picked a candidate for each review slot. Feel free to override these selections if you think someone else would be better-suited or use the GitLab Review Workload Dashboard to find other available reviewers.
To read more on how to use the reviewer roulette, please take a look at the Engineering workflow and code review guidelines.
Once you've decided who will review this merge request, mention them as you normally would! Danger does not automatically notify them for you.
Reviewer Maintainer @acook.gitlab
(UTC-5, 6 hours behind author)
@stanhu
(UTC-8, 9 hours behind author)
If needed, you can retry the
danger-review
job that generated this comment.Generated by
DangerEdited by ****- Resolved by 🤖 GitLab Bot 🤖
Proper labels assigned to this merge request. Please ignore me.
@eduardobonet
- please see the following guidance and update this merge request.1 Error Please add typebug typefeature, or typemaintenance label to this merge request. Edited by 🤖 GitLab Bot 🤖
added maintenancedependency typemaintenance labels
- Resolved by Igor Drozdov
Hey @igor.drozdov, can you review this?
requested review from @igor.drozdov
requested review from @GitLabDuo
In my review, I have left a recommendation regarding unused variables and code clarity. I cover topics related to code optimization and readability. Based on the comment, I estimate there is a small amount of work required to address the feedback, but this is only an estimate.
Edited by GitLab Duo- Resolved by Eduardo Bonet
- Resolved by Igor Drozdov
- Resolved by Igor Drozdov
requested review from @igor.drozdov
started a merge train
mentioned in commit 3b8c3676