myModel

Project information

myModel is a microservice for deploying local LLMs served over HTTP, with simple example code for running models on a local GPU via vLLM and communicating through Quart. It is explicitly an alpha — started, incomplete, and non-functional in some places. It is a scratchpad for local-serving experiments rather than a product. It is on the backlog and not under active development.

153 Commits
3 Branches
2 Tags

README
Mozilla Public License 2.0

Created on

August 24, 2025

Loading