Pinned Loading

1. mlc-llm mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 22.4k 2k

2. web-llm web-llm Public

   High-performance In-browser LLM Inference Engine

   TypeScript 17.7k 1.2k

3. mlc-zh mlc-zh Public

   Python 630 69

4. mlc-en mlc-en Public

   Python 453 62

5. web-llm-chat web-llm-chat Public

   Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

   TypeScript 998 208

6. xgrammar xgrammar Public

   Fast, Flexible and Portable Structured Generation

   C++ 1.6k 137