Fastest kernels written from scratch

PTX ISA 9.1 documentation converted to searchable markdown. Includes Claude Code skill for CUDA development.

From Minimal GEMM to Everything

GPU programming related news and material links

GPU documentation for humans

A fast communication-overlapping library for tensor/expert parallelism on GPUs.

Distributed Compiler based on Triton for Parallel Systems

My learning notes for ML SYS.

TensorRT inference framework for SAM2

Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.

A small C compiler

CUDA Templates and Python DSLs for High-Performance Linear Algebra

FlashInfer: Kernel Library for LLM Serving

A Easy-to-understand TensorOp Matmul Tutorial

row-major matmul optimization

Step-by-step optimization of CUDA SGEMM

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (p…

You like pytorch? You like micrograd? You love tinygrad! ❤️

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

how to optimize some algorithm in cuda.

A beautiful stack trace pretty printer for C++

Open Machine Learning Compiler Framework

A list of awesome compiler projects and papers for tensor computation and deep learning.

A playbook for systematically maximizing the performance of deep learning models.

The Linux perf GUI for performance analysis.

An Open Source Implementation of the Actor Model in C++