Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

Check if a number is equal to 13.

FlashInfer: Kernel Library for LLM Serving

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

DeepGEMM: clean and efficient BLAS kernel library on GPU

Bootstrap Kubernetes the hard way. No scripts.

Drop-in Acceleration of SQL/PromQL queries

From-scratch implementation of OpenAI's GPT-OSS model in Python. No Torch, No GPUs.

PyTorch implementation of Hash Embeddings (NIPS 2017). Submission to the NIPS Implementation Challenge.

xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

计算机自学指南

Accessible large language models via k-bit quantization for PyTorch.

Nano vLLM

A curated list of awesome Deep Learning tutorials, projects and communities.

A curated list of awesome Machine Learning frameworks, libraries and software.

The definitive list that answers "I want to do X in Python, which tool should I use?"

A curated list to learn about distributed systems

Large Language Model (LLM) Systems Paper List

Master programming by recreating your favorite technologies from scratch.

Awesome-LLM: a curated list of Large Language Model