A kernel library written in tilelang

A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It helps improve custom GPU operators with reproducible workflo…

Accelerating MoE with IO and Tile-aware Optimizations

A Quirky Assortment of CuTe Kernels

Persistent file-based planning for AI coding agents and long-running tasks. Crash-proof markdown plans, session recovery after /clear and compaction, per-turn re-injection against context rot, dete…

An agentic skills framework & software development methodology that works.

AI agents running research on single-GPU nanochat training automatically

高性能短序列稀疏Mask Attention CUDA算子，针对<1K序列+75%稀疏度优化

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

A Next-Generation Training Engine Built for Ultra-Large MoE Models

KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

High Performance LLM Inference Operator Library

Fused SwiGLU Triton kernels

📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).

From Minimal GEMM to Everything

Triton implementation of FlashAttention2 that adds Custom Masks.

[DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror

Efficient Triton Kernels for LLM Training

Collection of kernels written in Triton language

DeepGEMM: clean and efficient BLAS kernel library on GPU

DeepEP: an efficient expert-parallel communication library

Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).