You like pytorch? You like micrograd? You love tinygrad! ❤️

Models and examples built with TensorFlow

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

Open deep learning compiler stack for cpu, gpu and specialized accelerators

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance…

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Fast and Accurate ML in 3 Lines of Code

Making large AI models cheaper, faster and more accessible

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (V…

Fast and memory-efficient exact attention

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

High-performance In-browser LLM Inference Engine

Summaries and resources for Designing Machine Learning Systems book (Chip Huyen, O'Reilly 2022)

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Hackable and optimized Transformers building blocks, supporting a composable construction.

Supercharge Your Model Training

An elegant PyTorch deep reinforcement learning library.

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

Machine Learning Engineering Open Book

Facebook AI Research's Automatic Speech Recognition Toolkit

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Everything we actually know about the Apple Neural Engine (ANE)

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Point Cloud Library (PCL)

Atmosphère is a work-in-progress customized firmware for the Nintendo Switch.