Train transformer language models with reinforcement learning.

ByteCheckpoint: An Unified Checkpointing Library for LFMs

An Easy-to-use, Scalable and High-performance RLHF Framework based on Ray (PPO & GRPO & REINFORCE++ & TIS & vLLM & Ray & Dynamic Sampling & Async Agentic RL)

verl: Volcano Engine Reinforcement Learning for LLMs

Infiniband Verbs Performance Tests

RDMA core userspace libraries and daemons

Large Context Attention

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

A PyTorch native platform for training generative AI models

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Rotary Transformer

Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

深度学习经典、新论文逐段精读

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, etc.

An industrial deep learning framework for high-dimension sparse data

Kubernetes-native Deep Learning Framework

DLRover: An Automatic Distributed Deep Learning System

Policy based networking for cloud native applications

flannel is a network fabric for containers, designed for Kubernetes

gRPC to JSON proxy generator following the gRPC HTTP spec

PyTorch extensions for high performance and large scale training.

Making large AI models cheaper, faster and more accessible

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

Giving Kubernetes Superpowers to everyone