vite-webllm

Project information

An offline chatbot powered by WebLLM. Some LLMs available for loading are Llama-3.2, Mistral v0.3 and Stablelm 2. No MLOps required for deployment. Runs in-brower using WebGPU. Demo at: https://vite-webllm.onrender.com

LLMs webgpu offline tool web Node.js

35 Commits
1 Branch
0 Tags

README
Apache License 2.0

Created on

April 19, 2025

Loading