Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jun 2, 2025

• [algo] OPO: add implementations and descriptions for OPO (On-Policy RL with Optimal Reward Baseline) (#1796)

  Show description for a4b1bb7
  

  YRdddream

  and

  eric-haibin-lin

  authored
  a4b1bb7View commit details

  Copy full SHA for a4b1bb7

  Browse repository at this point

• [AMD] fix: Add support for RAY_EXPERIMENTAL_NOSET_*_VISIBLE_DEVICES (Fix AMD support) (#1465)

  Show description for 07897f8
  HollowMan6

  authored
  07897f8View commit details

  Copy full SHA for 07897f8

  Browse repository at this point

• [bugfix] fix select_idxs function in DataProto (#1794)

  Show description for ea81658
  

  Moyu-42

  and

  keithsun

  authored
  ea81658View commit details

  Copy full SHA for ea81658

  Browse repository at this point

• chore: fix typos across codebase (#1805)

  Show description for 0e127b2
  sukrucildirr

  authored
  0e127b2View commit details

  Copy full SHA for 0e127b2

  Browse repository at this point

• [feat] worker_group: support custom label for specific devices (#1773)

  Show description for 6e0e860
  ZDJeffrey

  authored
  6e0e860View commit details

  Copy full SHA for 6e0e860

  Browse repository at this point

• [CI] test: disable unstable test temporarily (#1799)

  Show description for b93b9bc
  eric-haibin-lin

  authored
  b93b9bcView commit details

  Copy full SHA for b93b9bc

  Browse repository at this point

Commits on Jun 1, 2025

• [eval] fix: fix main_eval (#1797)

  vermouth1992

  authored
  366d29cView commit details

  Copy full SHA for 366d29c

  Browse repository at this point

• remove redundant 'get_custom_reward_fn' function (#1791)

  Show description for 3126c8b
  vllbc

  authored
  3126c8bView commit details

  Copy full SHA for 3126c8b

  Browse repository at this point

• fix import issue for mcore package (#1775)

  Show description for 1fd729c
  

  jinqinn

  authored
  1fd729cView commit details

  Copy full SHA for 1fd729c

  Browse repository at this point

• fix freeze router weights for Qwen2MoE (#1792)

  yzlnew

  authored
  ad94700View commit details

  Copy full SHA for ad94700

  Browse repository at this point

• [doc] fix: Fix `doc_test`ci workflow pipeline (#1767)

  Show description for 0ae5056
  hongpeng-guo

  authored
  0ae5056View commit details

  Copy full SHA for 0ae5056

  Browse repository at this point

• [sglang] refactor: Unify async rollout under SGLangRollout, and support sglang==0.4.6.post5 (#1717)

  Show description for 4de247f
  

  5 peopleauthored
  4de247fView commit details

  Copy full SHA for 4de247f

  Browse repository at this point

• [docs] lora: fix lora image and add GRPO docs (#1788)

  Show description for cef6361
  eric-haibin-lin

  authored
  cef6361View commit details

  Copy full SHA for cef6361

  Browse repository at this point

Commits on May 31, 2025

• [docs] LORA: Train RL(HF) algorithms with LoRA support (#1755)

  Show description for ab97d9b
  

  thelongestusernameofall

  and

  eric-haibin-lin

  authored
  ab97d9bView commit details

  Copy full SHA for ab97d9b

  Browse repository at this point

• [docs] ppo: add a page for PPO algorithm (#1781)

  Show description for 106d33f
  eric-haibin-lin

  authored
  106d33fView commit details

  Copy full SHA for 106d33f

  Browse repository at this point

• [sglang] Feat: Search Tool Invocation in Multi-Turn RL Training (#1682)

  Lins-01

  authored
  c5bc81bView commit details

  Copy full SHA for c5bc81b

  Browse repository at this point

Commits on May 30, 2025

• [feat] dataproto: Supporting new operations (sample_level_repeat, unfold_column_chunks) for `DataProto` (#1761)

  Show description for e23e67b
  hongpeng-guo

  authored
  e23e67bView commit details

  Copy full SHA for e23e67b

  Browse repository at this point

• [docs] Add linux-arm64 platform tensordict package version problem handle FAQ (#1776)

  Show description for 316644d
  leo-pony

  authored
  316644dView commit details

  Copy full SHA for 316644d

  Browse repository at this point

• [BREAKING] config: set the default value of actor.entropy_coeff to 0 (#1770)

  Show description for 2aed8d0
  eric-haibin-lin

  authored
  2aed8d0View commit details

  Copy full SHA for 2aed8d0

  Browse repository at this point

• [refactor] update func generator implementation to improve its observability (#1762)

  Show description for ed3767d
  hongpeng-guo

  authored
  ed3767dView commit details

  Copy full SHA for ed3767d

  Browse repository at this point

• fix a bug that Moe's GPU memory offload is not properly handled (#1766)

  Show description for 2981aa2
  LiuXTao

  authored
  2981aa2View commit details

  Copy full SHA for 2981aa2

  Browse repository at this point

• [docs][NPU] Document optimize: added the dataset preparation step to ascend quick start guide (#1763)

  Show description for 562ac53
  leo-pony

  authored
  562ac53View commit details

  Copy full SHA for 562ac53

  Browse repository at this point

• [fix] self.reward_module._handle.reshard(True) not required for fsdp2 (#1765)

  Show description for 28a31d1
  liyc-ai

  authored
  28a31d1View commit details

  Copy full SHA for 28a31d1

  Browse repository at this point

• [feat] support kimi_vl VLM model (#1639)

  Show description for 96903e0
  ShareLer

  authored
  96903e0View commit details

  Copy full SHA for 96903e0

  Browse repository at this point

• [vlm] Support ulysses sequence parallelism for vlm (#1739)

  Show description for 9c50ffd
  popomen

  authored
  9c50ffdView commit details

  Copy full SHA for 9c50ffd

  Browse repository at this point

Commits on May 29, 2025

• [fix] moonlight runnable with trust_remote_code (#1749)

  ETOgaosion

  authored
  55f13ffView commit details

  Copy full SHA for 55f13ff

  Browse repository at this point

• [feat] add fsdp2 to fsdp_sft_trainer (#1713)

  Show description for 195f61b
  0x0C001

  authored
  195f61bView commit details

  Copy full SHA for 195f61b

  Browse repository at this point

• Fix copy_to_local function calls with incorrect argument usage (#1756)

  Show description for 7853292
  

  qyhfrank

  and

  qingyuhao

  authored
  7853292View commit details

  Copy full SHA for 7853292

  Browse repository at this point

• Add an example script for PF-PPO training (#1753)

  Show description for 904a252
  DtYXs

  authored
  904a252View commit details

  Copy full SHA for 904a252

  Browse repository at this point

• [rollout] feat: Implement sglang async rollout and multi-turn using AsyncServerBase (#1698)

  Show description for b8ae4a1
  chenhaiq

  authored
  b8ae4a1View commit details

  Copy full SHA for b8ae4a1

  Browse repository at this point

• fix: show last step progress bar (#1750)

  Show description for 1b17bb6
  shinytang6

  authored
  1b17bb6View commit details

  Copy full SHA for 1b17bb6

  Browse repository at this point

• feat: sandbox fusion for multi-turn (#1525)

  Show description for de553a2
  Irvingwangjr

  authored
  de553a2View commit details

  Copy full SHA for de553a2

  Browse repository at this point

• [ray] fix: error when bind async method in create_colocated_worker (#1745)

  Show description for bb4f97b
  chenhaiq

  authored
  bb4f97bView commit details

  Copy full SHA for bb4f97b

  Browse repository at this point

• [docs] readme: add lora and move social icons (#1743)

  eric-haibin-lin

  authored
  abb87bcView commit details

  Copy full SHA for abb87bc

  Browse repository at this point

Commits on May 28, 2025

• Improve run_qwen3moe-30b_megatron training script (#1742)

  xichengpro

  authored
  913ca6eView commit details

  Copy full SHA for 913ca6e

  Browse repository at this point