Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 83.5k 18.3k

2. oobabooga/textgen oobabooga/textgen Public

   Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

   Python 47.4k 6k

3. OpenBMB/MiniCPM-V OpenBMB/MiniCPM-V Public

   A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone

   Python 25.7k 2k

4. huggingface/llm-vscode huggingface/llm-vscode Public

   LLM powered development for VSCode

   TypeScript 1.3k 143

5. mlc-ai/llm-perf-bench mlc-ai/llm-perf-bench Public

   Python 122 13

6. llm-vscode-inference-server llm-vscode-inference-server Public

   An endpoint server for efficiently serving quantized open-source LLMs for code.

   Python 59 11