Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on May 27, 2025

• run ppo

  shwgao

  committed
  eb222e3View commit details

  Copy full SHA for eb222e3

  Browse repository at this point

Commits on May 23, 2025

• chore(ci): support FSDP2 for multi-turn SGLangRollout with tool calling (#1650)

  zyzshishui

  authored
  96c181aView commit details

  Copy full SHA for 96c181a

  Browse repository at this point

• [NPU] feat: Support FSDP worker and vLLM Ascend (#332)

  Show description for 0528ba1
  

  3 peopleauthored
  0528ba1View commit details

  Copy full SHA for 0528ba1

  Browse repository at this point

• fix: entropy in DAPO (#1652)

  Show description for a7b2e29
  tongyx361

  authored
  a7b2e29View commit details

  Copy full SHA for a7b2e29

  Browse repository at this point

• [CI] feat: add ignore for CI of SPIN & SPPO (#1653)

  Show description for c4faf5c
  tongyx361

  authored
  c4faf5cView commit details

  Copy full SHA for c4faf5c

  Browse repository at this point

• fix: only load reference policy when needed in DAPO (#1651)

  Show description for cdee00d
  tongyx361

  authored
  cdee00dView commit details

  Copy full SHA for cdee00d

  Browse repository at this point

• fix: add `loss_agg_mode` to critics (#1340)

  Show description for 9ddc725
  tongyx361

  authored
  9ddc725View commit details

  Copy full SHA for 9ddc725

  Browse repository at this point

• Activation Offloading (#1220)

  Show description for aaaaaab
  imh966

  authored
  aaaaaabView commit details

  Copy full SHA for aaaaaab

  Browse repository at this point

• [megatron] feat: save hf model config in megatron checkpoint manager (#1562)

  Show description for 54a5e6e
  0x404

  authored
  54a5e6eView commit details

  Copy full SHA for 54a5e6e

  Browse repository at this point

• Add explicit position_ids to model.generate in hf rollout (#1637)

  Show description for 2c179da
  Geaming2002

  authored
  2c179daView commit details

  Copy full SHA for 2c179da

  Browse repository at this point

Commits on May 22, 2025

• Mert/passatk advantage (#1621)

  mertunsall

  authored
  01abd3cView commit details

  Copy full SHA for 01abd3c

  Browse repository at this point

• [docs] recipe: fix spin README (#1647)

  Show description for 6dfa11a
  zhaochenyang20

  authored
  6dfa11aView commit details

  Copy full SHA for 6dfa11a

  Browse repository at this point

• [megatron] optimization: avoid padding to logits (#1629)

  Show description for 04acd09
  ISEEKYAN

  authored
  04acd09View commit details

  Copy full SHA for 04acd09

  Browse repository at this point

• [Recipe] SPIN: spin algorithm implementation (#1407)

  Show description for 867d302
  

  cedricbeta

  and

  eric-haibin-lin

  authored
  867d302View commit details

  Copy full SHA for 867d302

  Browse repository at this point

• [BugFix] Fix sglang and vllm engine args (#1634)

  Show description for c803b1f
  ETOgaosion

  authored
  c803b1fView commit details

  Copy full SHA for c803b1f

  Browse repository at this point

• [PRIME]bug fix: reward scoring hangs after progress reaches 100% (#1466)

  Show description for 6cbb051
  CajZella

  authored
  6cbb051View commit details

  Copy full SHA for 6cbb051

  Browse repository at this point

• [Megatron][BREAKING] Allow override of transformer config to enable custom megatron features like variable PP layers distribution, with CI tests (#1555)

  Show description for 1cfa2be
  ETOgaosion

  authored
  1cfa2beView commit details

  Copy full SHA for 1cfa2be

  Browse repository at this point

• [docker] aws efa driver dockerfile (#1631)

  Show description for be215d7
  spacegoing

  authored
  be215d7View commit details

  Copy full SHA for be215d7

  Browse repository at this point

• [vllm] feat: add `engine_kwargs` in vllm_rollout_spmd to set params in vllm engine (#1442)

  Show description for c07013e
  zhangyongxin121

  authored
  c07013eView commit details

  Copy full SHA for c07013e

  Browse repository at this point

Commits on May 21, 2025

• docs: Add RM-R1 to awesome work list (#1608)

  Show description for 821689e
  GaotangLi

  authored
  821689eView commit details

  Copy full SHA for 821689e

  Browse repository at this point

• Expose `engine_kwargs` from SGLang to Verl configuration (#1616)

  Show description for 72683a7
  hebiao064

  authored
  72683a7View commit details

  Copy full SHA for 72683a7

  Browse repository at this point

• [minor] fix: use init_empty_weights instead of torch.device("meta") (#1587)

  0x404

  authored
  d475654View commit details

  Copy full SHA for d475654

  Browse repository at this point

• [fix] img not displaying on single controller doc (#1622)

  Show description for cbc02eb
  zw0610

  authored
  cbc02ebView commit details

  Copy full SHA for cbc02eb

  Browse repository at this point

• [recipe] feat: support running dapo using main_ppo (#1612)

  Show description for 2dc3e0e
  vermouth1992

  authored
  2dc3e0eView commit details

  Copy full SHA for 2dc3e0e

  Browse repository at this point

• Simplify FSDP SGLang pre and post process (#1609)

  Show description for 8970cb0
  hebiao064

  authored
  8970cb0View commit details

  Copy full SHA for 8970cb0

  Browse repository at this point

• [constant scheduler] fix: model won't be updated on first training step (#1463)

  0x404

  authored
  80af51bView commit details

  Copy full SHA for 80af51b

  Browse repository at this point

• [megatron] support megatron expert parallel (#1467)

  Show description for add17f0
  

  ISEEKYAN

  and

  ETOgaosion

  authored
  add17f0View commit details

  Copy full SHA for add17f0

  Browse repository at this point

• [Docker Image] update images and fix sglang installation (#1606)

  Show description for 7b0426a
  ETOgaosion

  authored
  7b0426aView commit details

  Copy full SHA for 7b0426a

  Browse repository at this point

• docs: update adoption and doc index (#1607)

  Show description for d135072
  eric-haibin-lin

  authored
  d135072View commit details

  Copy full SHA for d135072

  Browse repository at this point

Commits on May 20, 2025

• Remove unnecessary broadcast (#1597)

  Show description for 0d3360a
  hebiao064

  authored
  0d3360aView commit details

  Copy full SHA for 0d3360a

  Browse repository at this point

• [misc] docs: add design doc of single_controller (#1549)

  Show description for f41a57a
  zw0610

  authored
  f41a57aView commit details

  Copy full SHA for f41a57a

  Browse repository at this point

• [BugFix] Megatron: fix missing grad_norm and lr calculation, and fix fsdp grad_norm storage (#1601)

  Show description for 1d4e23a
  ETOgaosion

  authored
  1d4e23aView commit details

  Copy full SHA for 1d4e23a

  Browse repository at this point

• Support multi-turn rollout with Qwen chat template (#1593)

  Show description for 15b1b15
  jybsuper

  authored
  15b1b15View commit details

  Copy full SHA for 15b1b15

  Browse repository at this point

• Disable fused kernels in prime (#1598)

  Show description for a3c4cb3
  plutoZZZZ

  authored
  a3c4cb3View commit details

  Copy full SHA for a3c4cb3

  Browse repository at this point

• [rollout] perf: replace AsyncOpenAI to aiohttp client in ChatCompletionScheduler (#1588)

  Show description for 3eaaf24
  wuxibin89

  authored
  3eaaf24View commit details

  Copy full SHA for 3eaaf24

  Browse repository at this point