A high-throughput and memory-efficient inference and serving engine for LLMs

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Fast and memory-efficient exact attention

A Native-PyTorch Library for LLM Fine-tuning

A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)

Native PyTorch library for quantization and sparsity

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

A place to store reusable transformer components of my own creation or found on the interwebs

Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code

Federated Learning Simulator (FLSim) is a flexible, standalone core library that simulates FL settings with a minimal, easy-to-use API. FLSim is domain-agnostic and accommodates many use cases such…

Deep learning framework to train, deploy, and ship AI products Lightning fast.

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.

Enabling PyTorch on Google TPU

Optimized primitives for collective multi-GPU communication

This repository hosts code that supports the testing infrastructure for the main PyTorch repo. For example, this repo hosts the logic to track disabled tests and slow tests, as well as our continua…

Continuous builder and binary build scripts for pytorch

GeoGuess is an open-source geography game with Google Map StreetView. You can play solo or with your friends simultaneously.

PyTorch GitHub bot written in probot

Pull Requests for GitHub repository settings

this is a playground for github automation

Testing downstream libraries using pytorch release candidates

Jenkins job definitions for OSSCI