Train transformer language models with reinforcement learning.

Easily train a good VC model with voice data <= 10 mins!

verl: Volcano Engine Reinforcement Learning for LLMs

SGLang is a fast serving framework for large language models and vision language models.

GUI for a Vocal Remover that uses Deep Neural Networks.

FlashInfer: Kernel Library for LLM Serving

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A high-throughput and memory-efficient inference and serving engine for LLMs

PyTorch native quantization and sparsity for training and inference

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

Robust recipes to align language models with human and AI preferences

LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning

Efficient Large Language Models: A Survey

A curated list for Efficient Large Language Models

🚠 Python/Cython wrapper for liblbfgs

Hyperparameter tuning for humans

Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.

An End-to-end Outlier Detection System

Facebook's branch of Apache Thrift, including a new C++ server.

The missing package tap for robotics applications.

Differentiable architecture search for convolutional and recurrent networks

accessible AutoML for deep learning.

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.