Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. bolt.new bolt.new Public template

   Forked from stackblitz/bolt.new

   Prompt, run, edit, and deploy full-stack web applications

   TypeScript

3. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

4. open-webui open-webui Public

   Forked from open-webui/open-webui

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

   JavaScript

5. ollama ollama Public

   Forked from ollama/ollama

   Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

   Go

6. ktransformers ktransformers Public

   Forked from kvcache-ai/ktransformers

   A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

   Python