A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.

MAGI-2-preview: Scaling Video Generation Models Efficiently

Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly between them.

My blog website.

MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts

A tutorial on modern GPU programming for machine learning systems

SGLang-native serving for the Moet sign-symmetric W2 expert format with SM120 W2/W4 kernels, GLM-5.2 NVFP4 TP4 on 4x RTX PRO 6000

High-performance GPU kernels written in TIRx.

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

A compiler, optimizer and executor for financial expressions and factors

Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.

Graphs that teach > graphs that impress. Turn any code into an interactive knowledge graph you can explore, search, and ask questions about. Works with Claude Code, Codex, Cursor, Copilot, Gemini C…

LLM KV cache compression made easy

Simple samples for TensorRT programming

TokenSpeed is a speed-of-light LLM inference engine.

A project to improve skills of large language models

high-performance linear attention kernel library built on TileLang

From Automated Idea Factory to Realization

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downs…

Run your GitHub Actions locally 🚀

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

An agentic skills framework & software development methodology that works.

Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1

A plug-and-play compiler that delivers free-lunch optimizations for both inference and training.