LLM training in simple, raw C/CUDA

Instant neural graphics primitives: lightning fast NeRF and more

The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"

Fast parallel CTC.

Squeeze-and-Excitation Networks

Tile primitives for speedy kernels

how to optimize some algorithm in cuda.

cuGraph - RAPIDS Graph Analytics Library

Sample codes for my CUDA programming book

[ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl

Fully Convolutional Instance-aware Semantic Segmentation

NCCL Tests

[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.

Examples demonstrating available options to program multiple GPUs in a single node or a cluster

Reference implementation of real-time autoregressive wavenet inference

Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches

Source code that accompanies The CUDA Handbook.

Integral Human Pose Regression

A UNIVERSAL MUSIC TRANSLATION NETWORK - a method for translating music across musical instruments and styles.

NVIDIA-accelerated zero latency video compression library for interactive remoting applications

GPU implementation of a fast generalized ANS (asymmetric numeral system) entropy encoder and decoder, with extensions for lossless compression of numerical and other data types in HPC/ML applications.

A CUDA backend for Torch7

GPU-accelerated Levenberg-Marquardt curve fitting in CUDA

Facebook's CUDA extensions.

An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).

CGBN: CUDA Accelerated Multiple Precision Arithmetic (Big Num) using Cooperative Groups

Fast CUDA Kernels for ResNet Inference.

Improved 3DGS rasterizer.