Skip to content
Snippets Groups Projects

feat: adds script to test a models TPS

Merged Eduardo Bonet requested to merge ebonet/tps_testing_script into main
All threads resolved!

What does this merge request do and why?

Adds a script to compute the TPS of a model deployed at an endpoint. This is useful to develop documentation and for users to quickly test the connection a to a model.

How to set up and validate locally

poetry run compute-tps --model-identifier <model-identifier> --model-endpoint <model-endpoint> --api-key <api-key> --requests 1

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Eduardo Bonet

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Eduardo Bonet resolved all threads

    resolved all threads

  • Igor Drozdov
  • Eduardo Bonet requested review from @igor.drozdov

    requested review from @igor.drozdov

  • Eduardo Bonet added 1 commit

    added 1 commit

    Compare with previous version

  • Igor Drozdov resolved all threads

    resolved all threads

  • Igor Drozdov approved this merge request

    approved this merge request

  • merged

  • Igor Drozdov mentioned in commit 3b8c3676

    mentioned in commit 3b8c3676

  • Please register or sign in to reply
    Loading