LLM training in simple, raw C/CUDA

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, s…

Static suckless single batch CUDA-only qwen3-0.6B mini inference engine

Step-by-step optimization of CUDA SGEMM

一款便捷的抢占显卡脚本

CUDA Matrix Multiplication Optimization

A set of hands-on tutorials for CUDA programming

easy cuda code

🌈 Solutions of LeetGPU

Official implementation of "MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Training"

CUDA Embedding Lookup Kernel Library

some hpc project for learning

Build CUDA Neural Network From Scratch

source code for TaiChi (A Hybrid Compression Format for Binary Sparse Matrix-Vector Multiplication on GPU)