Pinned Loading

1. GSoC-2022-DistSQL-Convert-Tool GSoC-2022-DistSQL-Convert-Tool Public

   GSoC 2022 - Final Project Report

   2 1

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

3. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

4. tilelang tilelang Public

   Forked from tile-ai/tilelang

   Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

   Python 2

5. BitNet BitNet Public

   Forked from microsoft/BitNet

   Official inference framework for 1-bit LLMs

   Python

6. llama.cpp llama.cpp Public

   Forked from Eddie-Wang1120/llama.cpp

   LLM inference in C/C++

   C++ 2 4