Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on May 31, 2025

• [docs] LORA: Train RL(HF) algorithms with LoRA support (#1755)

  Show description for ab97d9b
  

  thelongestusernameofall

  and

  eric-haibin-lin

  authored
  ab97d9bView commit details

  Copy full SHA for ab97d9b

  Browse repository at this point

• [docs] ppo: add a page for PPO algorithm (#1781)

  Show description for 106d33f
  eric-haibin-lin

  authored
  106d33fView commit details

  Copy full SHA for 106d33f

  Browse repository at this point

• [sglang] Feat: Search Tool Invocation in Multi-Turn RL Training (#1682)

  Lins-01

  authored
  c5bc81bView commit details

  Copy full SHA for c5bc81b

  Browse repository at this point

Commits on May 30, 2025

• [feat] dataproto: Supporting new operations (sample_level_repeat, unfold_column_chunks) for `DataProto` (#1761)

  Show description for e23e67b
  hongpeng-guo

  authored
  e23e67bView commit details

  Copy full SHA for e23e67b

  Browse repository at this point

• [docs] Add linux-arm64 platform tensordict package version problem handle FAQ (#1776)

  Show description for 316644d
  leo-pony

  authored
  316644dView commit details

  Copy full SHA for 316644d

  Browse repository at this point

• [BREAKING] config: set the default value of actor.entropy_coeff to 0 (#1770)

  Show description for 2aed8d0
  eric-haibin-lin

  authored
  2aed8d0View commit details

  Copy full SHA for 2aed8d0

  Browse repository at this point

• [refactor] update func generator implementation to improve its observability (#1762)

  Show description for ed3767d
  hongpeng-guo

  authored
  ed3767dView commit details

  Copy full SHA for ed3767d

  Browse repository at this point

• fix a bug that Moe's GPU memory offload is not properly handled (#1766)

  Show description for 2981aa2
  LiuXTao

  authored
  2981aa2View commit details

  Copy full SHA for 2981aa2

  Browse repository at this point

• [docs][NPU] Document optimize: added the dataset preparation step to ascend quick start guide (#1763)

  Show description for 562ac53
  leo-pony

  authored
  562ac53View commit details

  Copy full SHA for 562ac53

  Browse repository at this point

• [fix] self.reward_module._handle.reshard(True) not required for fsdp2 (#1765)

  Show description for 28a31d1
  liyc-ai

  authored
  28a31d1View commit details

  Copy full SHA for 28a31d1

  Browse repository at this point

• [feat] support kimi_vl VLM model (#1639)

  Show description for 96903e0
  ShareLer

  authored
  96903e0View commit details

  Copy full SHA for 96903e0

  Browse repository at this point

• [vlm] Support ulysses sequence parallelism for vlm (#1739)

  Show description for 9c50ffd
  popomen

  authored
  9c50ffdView commit details

  Copy full SHA for 9c50ffd

  Browse repository at this point

Commits on May 29, 2025

• [fix] moonlight runnable with trust_remote_code (#1749)

  ETOgaosion

  authored
  55f13ffView commit details

  Copy full SHA for 55f13ff

  Browse repository at this point

• [feat] add fsdp2 to fsdp_sft_trainer (#1713)

  Show description for 195f61b
  0x0C001

  authored
  195f61bView commit details

  Copy full SHA for 195f61b

  Browse repository at this point

• Fix copy_to_local function calls with incorrect argument usage (#1756)

  Show description for 7853292
  

  qyhfrank

  and

  qingyuhao

  authored
  7853292View commit details

  Copy full SHA for 7853292

  Browse repository at this point

• Add an example script for PF-PPO training (#1753)

  Show description for 904a252
  DtYXs

  authored
  904a252View commit details

  Copy full SHA for 904a252

  Browse repository at this point

• [rollout] feat: Implement sglang async rollout and multi-turn using AsyncServerBase (#1698)

  Show description for b8ae4a1
  chenhaiq

  authored
  b8ae4a1View commit details

  Copy full SHA for b8ae4a1

  Browse repository at this point

• fix: show last step progress bar (#1750)

  Show description for 1b17bb6
  shinytang6

  authored
  1b17bb6View commit details

  Copy full SHA for 1b17bb6

  Browse repository at this point

• feat: sandbox fusion for multi-turn (#1525)

  Show description for de553a2
  Irvingwangjr

  authored
  de553a2View commit details

  Copy full SHA for de553a2

  Browse repository at this point

• [ray] fix: error when bind async method in create_colocated_worker (#1745)

  Show description for bb4f97b
  chenhaiq

  authored
  bb4f97bView commit details

  Copy full SHA for bb4f97b

  Browse repository at this point

• [docs] readme: add lora and move social icons (#1743)

  eric-haibin-lin

  authored
  abb87bcView commit details

  Copy full SHA for abb87bc

  Browse repository at this point

Commits on May 28, 2025

• Improve run_qwen3moe-30b_megatron training script (#1742)

  xichengpro

  authored
  913ca6eView commit details

  Copy full SHA for 913ca6e

  Browse repository at this point

• [feat] lora: new feature -- LoRA support for PPO (#1127)

  Show description for 16f6c1e
  

  5 peopleauthored
  16f6c1eView commit details

  Copy full SHA for 16f6c1e

  Browse repository at this point

• [Docker Image] hot fix moonlight tokenizer request (#1740)

  ETOgaosion

  authored
  18fa5c7View commit details

  Copy full SHA for 18fa5c7

  Browse repository at this point

• Add support for PF-PPO (#1719)

  Show description for 75d2b36
  

  DtYXs

  and

  hiyouga

  authored
  75d2b36View commit details

  Copy full SHA for 75d2b36

  Browse repository at this point

• [misc] fix: reduce training iter in spin and sppo ci (#1738)

  Show description for 7c91b10
  PeterSH6

  authored
  7c91b10View commit details

  Copy full SHA for 7c91b10

  Browse repository at this point

• trainer: do not repeat "multi_modal_inputs" in generate_sequences() (#1604)

  Show description for cdad2e6
  GHGmc2

  authored
  cdad2e6View commit details

  Copy full SHA for cdad2e6

  Browse repository at this point

• [mcore] moonlight (small model with deepseekv3 arch) (#1284)

  Show description for be47ac4
  ISEEKYAN

  authored
  be47ac4View commit details

  Copy full SHA for be47ac4

  Browse repository at this point

• [BugFix] fix freeze_moe_router typo to enable the config option (#1732)

  Show description for 8fe4950
  ETOgaosion

  authored
  8fe4950View commit details

  Copy full SHA for 8fe4950

  Browse repository at this point

• [feat][BREAKING] Megatron support dynamic batch size, to rebalance the workloads (#1617)

  Show description for 432f9e9
  ETOgaosion

  authored
  432f9e9View commit details

  Copy full SHA for 432f9e9

  Browse repository at this point

• Fix Configuration for Micro Batch Size in Megatron's Ref Policy (#1700)

  Show description for 99e749a
  none0663

  authored
  99e749aView commit details

  Copy full SHA for 99e749a

  Browse repository at this point

• Update README.md (#1731)

  Show description for 9b186ed
  czx6858

  authored
  9b186edView commit details

  Copy full SHA for 9b186ed

  Browse repository at this point

• [mics][fix] Deprecate legacy `_default_compute_score` API and fix ray utils test (#1729)

  Show description for d5570c4
  hongpeng-guo

  authored
  d5570c4View commit details

  Copy full SHA for d5570c4

  Browse repository at this point

• [misc] feat: support logging rollout prob vs. actor probs for debugging purpose (#1712)

  Show description for 16a13d8
  vermouth1992

  authored
  16a13d8View commit details

  Copy full SHA for 16a13d8

  Browse repository at this point

Commits on May 27, 2025

• [docs] refactor: Adding doc strings and doc pages for public methods in `trainer` and `utils` (#1397)

  Show description for 34e409b
  

  hongpeng-guo

  and

  eric-haibin-lin

  authored
  34e409bView commit details

  Copy full SHA for 34e409b

  Browse repository at this point