Distributed RL System for LLM Reasoning

RLinf is a flexible and scalable open-source infrastructure designed for post-training foundation models (LLMs, VLMs, VLAs) via reinforcement learning.

siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems

Long-RL: Scaling RL to Long Sequences

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, GLM4…

A library for efficient similarity search and clustering of dense vectors.

Online RL with Simple Reward Enables Training VLA Models with Only One Trajectory

verl: Volcano Engine Reinforcement Learning for LLMs

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Ongoing research training transformer models at scale

Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success

A fast communication-overlapping library for tensor/expert parallelism on GPUs.

Benchmarking Knowledge Transfer in Lifelong Robot Learning

DeepEP: an efficient expert-parallel communication library

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

dataloading is my passion

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

ChineseDiachronicCorpus，中文历时语料库，横跨六十余年，包括腾讯历时新闻2000-2016，人民日报历时语料1946-2003，参考消息历时语料1957-2002。基于历时流通语料库，可用于历时语言变化计算、语言监测、社会文化变迁研究提供基础性的语料支持。