A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

A high-throughput and memory-efficient inference and serving engine for LLMs

CUDA Templates for Linear Algebra Subroutines

Submit stacked diffs to GitHub on the command line

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Development repository for the Triton language and compiler

Helpful tools and examples for working with flex-attention

LLM training in simple, raw C/CUDA

Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

⚡ Competitive Programming Library

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A library that allows for inference on probabilistic models

Pytorch domain library for recommendation systems

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.