Stars
A catalogue of Rust design patterns, anti-patterns and idioms
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
Puzzles for learning Triton
slime is an LLM post-training framework for RL Scaling.
🚀 Efficient implementations for emerging model architectures
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).
🟩⬜ Generates a snake game from a github user contributions graph and output a screen capture as animated svg or gif
Step-by-step optimization of CUDA SGEMM
Fast CUDA matrix multiplication from scratch
CUDA Templates and Python DSLs for High-Performance Linear Algebra
Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.
A high-throughput and memory-efficient inference and serving engine for LLMs
My learning notes for ML SYS.
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
SGLang is a high-performance serving framework for large language models and multimodal models.
Home Assistant custom component of conversation agent. It uses OpenAI to control your devices.
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。
The engine for haskell ide-integration. Not an IDE
The new Windows Terminal and the original Windows console host, all in the same place!