Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Mar 27, 2025

• In the GRPO example scripts, modify the `entropy_coeff` to 0 to ensure consistency with the GRPO paper. (#781)

  Show description for aab0176
  The-Hierophant

  authored
  aab0176View commit details

  Copy full SHA for aab0176

  Browse repository at this point

• prevent division by zero in SFT (#786)

  cpchenpi

  authored
  076acdfView commit details

  Copy full SHA for 076acdf

  Browse repository at this point

• fix: prevent NaN when all items are intentionally masked by adding epsilon to masked_mean (#782)

  The-Hierophant

  authored
  e9bcd2bView commit details

  Copy full SHA for e9bcd2b

  Browse repository at this point

• fix: set torch dtype to auto (#749)

  Show description for a1dd922
  ccclyu

  authored
  a1dd922View commit details

  Copy full SHA for a1dd922

  Browse repository at this point

Commits on Mar 26, 2025

• fix: prompt_token_ids should be list[int] instead of np.array (#772)

  Show description for fc27caf
  

  0x404

  and

  hiyouga

  authored
  fc27cafView commit details

  Copy full SHA for fc27caf

  Browse repository at this point

• Update math_dataset.py to fix typo in the annotation (#765)

  Show description for 591a476
  alexanderliu-creator

  authored
  591a476View commit details

  Copy full SHA for 591a476

  Browse repository at this point

• [Bug fix] change max_model_len to be configurable in vllm_rollout_spmd (#677)

  Show description for 7f10e57
  

  Tian Wang

  authored
  7f10e57View commit details

  Copy full SHA for 7f10e57

  Browse repository at this point

• [Feat] add max_ckpt_to_keep for old ckpt removal (#724)

  Show description for afb9f9f
  guanning03

  authored
  afb9f9fView commit details

  Copy full SHA for afb9f9f

  Browse repository at this point

• docs: doc improvements via Openhands, add SimpleRL-Zoo (#764)

  eric-haibin-lin

  authored
  9b5ffe4View commit details

  Copy full SHA for 9b5ffe4

  Browse repository at this point

• docs: support AMD (Rocm Kernel) - Merge upstream changes and update AMD tutorial (#741)

  Show description for 2970156
  

  yushengsu-thu

  and

  eric-haibin-lin

  authored
  2970156View commit details

  Copy full SHA for 2970156

  Browse repository at this point

Commits on Mar 25, 2025

• docker: Add dockerfile to build container for AWS Sagemaker training job (#763)

  BaiqingL

  authored
  8ee3faaView commit details

  Copy full SHA for 8ee3faa

  Browse repository at this point

• chore(deps): bump sglang[all] from 0.4.3.post3 to 0.4.4 (#646)

  Show description for deae725
  dependabot[bot]

  authored
  deae725View commit details

  Copy full SHA for deae725

  Browse repository at this point

• fix: prime refactor ignores extra_info (#717)

  ganler

  authored
  8594627View commit details

  Copy full SHA for 8594627

  Browse repository at this point

• docs: fix sglang installation rendering (#762)

  Show description for 6199b8c
  eric-haibin-lin

  authored
  6199b8cView commit details

  Copy full SHA for 6199b8c

  Browse repository at this point

• recipe: add reproducible PRIME baseline (#753)

  Show description for 0415b27
  ZefanW

  authored
  0415b27View commit details

  Copy full SHA for 0415b27

  Browse repository at this point

• [docs] Update the doc for vllm >= 0.8 (#755)

  Show description for fa18360
  BearBiscuit05

  authored
  fa18360View commit details

  Copy full SHA for fa18360

  Browse repository at this point

• refactor: unify ulysses flash attention patch to avoid single model patches (#735)

  Show description for ab7b941
  wuxibin89

  authored
  ab7b941View commit details

  Copy full SHA for ab7b941

  Browse repository at this point

• Add tqdm progress bar to RayPPOTrainer to visualize training progress (#615)

  Show description for 36c10bf
  

  BeSkyer

  and

  hiyouga

  authored
  36c10bfView commit details

  Copy full SHA for 36c10bf

  Browse repository at this point

Commits on Mar 23, 2025

• fix: slicing returns DataProto not DataProtoItem (#718)

  ganler

  authored
  44a65f9View commit details

  Copy full SHA for 44a65f9

  Browse repository at this point

• [feat] support a basic utility of VLM RLHF with sglang (#714)

  Show description for db1d325
  minleminzui

  authored
  db1d325View commit details

  Copy full SHA for db1d325

  Browse repository at this point

• [feat] Megatron checkpoint support for current Llama and Qwen models (#687)

  Show description for 5d0a7ea
  

  4 peopleauthored
  5d0a7eaView commit details

  Copy full SHA for 5d0a7ea

  Browse repository at this point

• Add GRPO CI to FSDP and Megatron simple e2e. (#711)

  Show description for 98a0208
  ETOgaosion

  authored
  98a0208View commit details

  Copy full SHA for 98a0208

  Browse repository at this point

• skip special tokens (#715)

  Show description for a339f6f
  gameofdimension

  authored
  a339f6fView commit details

  Copy full SHA for a339f6f

  Browse repository at this point

• Fix checkpoint loading in fsdp_checkpoint_manager.py and ray_trainer.py (#712)

  haoy-zzz

  authored
  c523a31View commit details

  Copy full SHA for c523a31

  Browse repository at this point

Commits on Mar 22, 2025

• fix: support transformers==4.50.0 (#704)

  Show description for 3f6d45d
  dirtyDan0

  authored
  3f6d45dView commit details

  Copy full SHA for 3f6d45d

  Browse repository at this point

Commits on Mar 21, 2025

• [Bug Fix] Fix SGLang rollout error under multi node (#652)

  ocss884

  authored
  612823aView commit details

  Copy full SHA for 612823a

  Browse repository at this point

• [misc] Add Ulysses parallel config precheck (#674)

  Show description for e67dea6
  uygnef

  authored
  e67dea6View commit details

  Copy full SHA for e67dea6

  Browse repository at this point

• docs: add vllm 0.8 page (#694)

  Show description for 0342042
  hiyouga

  authored
  0342042View commit details

  Copy full SHA for 0342042

  Browse repository at this point

• docs: fix broken news rendering (#691)

  eric-haibin-lin

  authored
  b2ad8fdView commit details

  Copy full SHA for b2ad8fd

  Browse repository at this point

Commits on Mar 20, 2025

• docs: Adding Openmanus-RL to the Awesome work (#688)

  Show description for 7df1ffc
  Kunlun-Zhu

  authored
  7df1ffcView commit details

  Copy full SHA for 7df1ffc

  Browse repository at this point

• [tracking] swanlab add `verl` config (#663)

  Show description for 9478885
  Zeyi-Lin

  authored
  9478885View commit details

  Copy full SHA for 9478885

  Browse repository at this point

• docs: add meetup slides (#681)

  eric-haibin-lin

  authored
  847bf25View commit details

  Copy full SHA for 847bf25

  Browse repository at this point

• Make Math-Verify Optional (#683)

  Show description for 529a4fe
  yyDing1

  authored
  529a4feView commit details

  Copy full SHA for 529a4fe

  Browse repository at this point

• [ci] fix ci (#675)

  vermouth1992

  authored
  5367156View commit details

  Copy full SHA for 5367156

  Browse repository at this point

Commits on Mar 19, 2025

• Update the description of DeepRetrieval (#664)

  Show description for 468adf2
  pat-jj

  authored
  468adf2View commit details

  Copy full SHA for 468adf2

  Browse repository at this point