Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Native PyTorch library for quantization and sparsity

SGLang is a fast serving framework for large language models and vision language models.

AI Tensor Engine for ROCm

Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

A high-throughput and memory-efficient inference and serving engine for LLMs

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Cost-efficient and pluggable Infrastructure components for GenAI inference

https://hf.co/hexgrad/Kokoro-82M

A Native-PyTorch Library for LLM Fine-tuning

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

NanoGPT (124M) quality in 7.8 8xH100-minutes

A native PyTorch Library for large model training