On-device AI across mobile, embedded and edge for PyTorch

Repository to host ROCm Developer Hub Notebook Tutorials

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.

An interface library for RL post training with environments.

PyTorch native quantization and sparsity for training and inference

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

Kernels & AI inference engine for mobile devices.

Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth

100+ Fine-tuning Tutorial Notebooks on Google Colab, Kaggle and more.

A high-throughput and memory-efficient inference and serving engine for LLMs

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen2.5, Qwen3, Llama, and more!

Tool for generating high quality Synthetic datasets

Context retrieval for AI agents across apps and databases

Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.

Easily build AI systems with Evals, RAG, Agents, fine-tuning, synthetic data, and more.

Fork of the Triton language and compiler for Windows support and easy installation

Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsely activated memory layers complement compute-heavy dense f…

Utils for Unsloth https://github.com/unslothai/unsloth

LLM inference in C/C++

Material for gpu-mode lectures

Cloudstate is a JavaScript database runtime.

SGLang is a fast serving framework for large language models and vision language models.

AllenAI's post-training codebase

Easily view and modify JSON datasets for large language models