cuJSON: A Highly Parallel JSON Parser for GPUs

AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Helpful kernel tutorials and examples for tile-based GPU programming

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

Code for the paper “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling”

Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools

A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.

flex-block-attn: an efficient block sparse attention computation library

DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang

Nex Venus Communication Library

Low overhead tracing library and trace visualizer for pipelined CUDA kernels

Perplexity open source garden for inference technology

High-throughput tensor loading for PyTorch

Hand-Rolled GPU communications library

Tutorial Exercises and Code for GPU Communications Tutorial at HOT Interconnects 2025

Contexts Optical Compression

Implement a reasoning LLM in PyTorch from scratch, step by step

A simple DSP crate

A collection of GPU tests and benchmarks for my own research.

Open source version of DOCA GPUNetIO and DOCA Verbs libraries (limited features) to enable GDAKI technology on RDMA (IB and RoCE)

Distributed MoE in a Single Kernel [NeurIPS '25]

DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit