Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Mar 27, 2025

• prevent division by zero in SFT (#786)

  cpchenpi

  authored
  076acdfView commit details

  Copy full SHA for 076acdf

  View code at this pointBrowse repository at this point

• fix: prevent NaN when all items are intentionally masked by adding epsilon to masked_mean (#782)

  The-Hierophant

  authored
  e9bcd2bView commit details

  Copy full SHA for e9bcd2b

  View code at this pointBrowse repository at this point

• fix: set torch dtype to auto (#749)

  Show description for a1dd922
  ccclyu

  authored
  a1dd922View commit details

  Copy full SHA for a1dd922

  View code at this pointBrowse repository at this point

Commits on Mar 26, 2025

• fix: prompt_token_ids should be list[int] instead of np.array (#772)

  Show description for fc27caf
  

  0x404

  and

  hiyouga

  authored
  fc27cafView commit details

  Copy full SHA for fc27caf

  View code at this pointBrowse repository at this point

• [Bug fix] change max_model_len to be configurable in vllm_rollout_spmd (#677)

  Show description for 7f10e57
  

  Tian Wang

  authored
  7f10e57View commit details

  Copy full SHA for 7f10e57

  View code at this pointBrowse repository at this point

• [Feat] add max_ckpt_to_keep for old ckpt removal (#724)

  Show description for afb9f9f
  guanning03

  authored
  afb9f9fView commit details

  Copy full SHA for afb9f9f

  View code at this pointBrowse repository at this point

Commits on Mar 25, 2025

• fix: prime refactor ignores extra_info (#717)

  ganler

  authored
  8594627View commit details

  Copy full SHA for 8594627

  View code at this pointBrowse repository at this point

• refactor: unify ulysses flash attention patch to avoid single model patches (#735)

  Show description for ab7b941
  wuxibin89

  authored
  ab7b941View commit details

  Copy full SHA for ab7b941

  View code at this pointBrowse repository at this point

• Add tqdm progress bar to RayPPOTrainer to visualize training progress (#615)

  Show description for 36c10bf
  

  BeSkyer

  and

  hiyouga

  authored
  36c10bfView commit details

  Copy full SHA for 36c10bf

  View code at this pointBrowse repository at this point

Commits on Mar 23, 2025

• fix: slicing returns DataProto not DataProtoItem (#718)

  ganler

  authored
  44a65f9View commit details

  Copy full SHA for 44a65f9

  View code at this pointBrowse repository at this point

• [feat] Megatron checkpoint support for current Llama and Qwen models (#687)

  Show description for 5d0a7ea
  

  4 peopleauthored
  5d0a7eaView commit details

  Copy full SHA for 5d0a7ea

  View code at this pointBrowse repository at this point

• skip special tokens (#715)

  Show description for a339f6f
  gameofdimension

  authored
  a339f6fView commit details

  Copy full SHA for a339f6f

  View code at this pointBrowse repository at this point

• Fix checkpoint loading in fsdp_checkpoint_manager.py and ray_trainer.py (#712)

  haoy-zzz

  authored
  c523a31View commit details

  Copy full SHA for c523a31

  View code at this pointBrowse repository at this point

Commits on Mar 22, 2025

• fix: support transformers==4.50.0 (#704)

  Show description for 3f6d45d
  dirtyDan0

  authored
  3f6d45dView commit details

  Copy full SHA for 3f6d45d

  View code at this pointBrowse repository at this point

Commits on Mar 21, 2025

• [Bug Fix] Fix SGLang rollout error under multi node (#652)

  ocss884

  authored
  612823aView commit details

  Copy full SHA for 612823a

  View code at this pointBrowse repository at this point

• [misc] Add Ulysses parallel config precheck (#674)

  Show description for e67dea6
  uygnef

  authored
  e67dea6View commit details

  Copy full SHA for e67dea6

  View code at this pointBrowse repository at this point

Commits on Mar 20, 2025

• [tracking] swanlab add `verl` config (#663)

  Show description for 9478885
  Zeyi-Lin

  authored
  9478885View commit details

  Copy full SHA for 9478885

  View code at this pointBrowse repository at this point

• Make Math-Verify Optional (#683)

  Show description for 529a4fe
  yyDing1

  authored
  529a4feView commit details

  Copy full SHA for 529a4fe

  View code at this pointBrowse repository at this point

Commits on Mar 18, 2025

• misc: change main_task to TaskRunner actor (#648)

  Show description for c6dc8b7
  wuxibin89

  authored
  c6dc8b7View commit details

  Copy full SHA for c6dc8b7

  View code at this pointBrowse repository at this point

• [Bug Fix] Revert the RLHFDataset truncation config (#645)

  Show description for ff13794
  ETOgaosion

  authored
  ff13794View commit details

  Copy full SHA for ff13794

  View code at this pointBrowse repository at this point

Commits on Mar 17, 2025

• [rollout] feat: add SGLang as rollout engine to verl (#490)

  Show description for 333e6d6
  

  ocss884

  and

  zhaochenyang20

  authored
  333e6d6View commit details

  Copy full SHA for 333e6d6

  View code at this pointBrowse repository at this point

Commits on Mar 15, 2025

• [misc] fix: validation batch repeat before feed into rollout (#614)

  PeterSH6

  authored
  cb943beView commit details

  Copy full SHA for cb943be

  View code at this pointBrowse repository at this point

• misc: separate metric utils from ppo trainer (#599)

  Show description for 6133ae9
  hiyouga

  authored
  6133ae9View commit details

  Copy full SHA for 6133ae9

  View code at this pointBrowse repository at this point

Commits on Mar 14, 2025

• Support for GRPO with Megatron backend (#592)

  Show description for c342069
  ETOgaosion

  authored
  c342069View commit details

  Copy full SHA for c342069

  View code at this pointBrowse repository at this point

• fix: Add error mechanism for mini-batch/batch size divisibility validation (#559)

  fyqqyf

  authored
  4d27461View commit details

  Copy full SHA for 4d27461

  View code at this pointBrowse repository at this point

• [config] feat: lr_warmup_steps (#564)

  Show description for 22657ba
  tongyx361

  authored
  22657baView commit details

  Copy full SHA for 22657ba

  View code at this pointBrowse repository at this point

• [update] delete useless config params (#591)

  BearBiscuit05

  authored
  99ea19aView commit details

  Copy full SHA for 99ea19a

  View code at this pointBrowse repository at this point

• [Config] Providing an option to turn off `torch.compile` in actor (#554)

  Show description for 5457469
  hongpeng-guo

  authored
  5457469View commit details

  Copy full SHA for 5457469

  View code at this pointBrowse repository at this point

• misc: remove redundant .to(device) (#565)

  Show description for d2db725
  dirtyDan0

  authored
  d2db725View commit details

  Copy full SHA for d2db725

  View code at this pointBrowse repository at this point

Commits on Mar 13, 2025

• fix bug #544 that 'left' and 'right' config for truncation don't work (#583)

  none0663

  authored
  e7c40b3View commit details

  Copy full SHA for e7c40b3

  View code at this pointBrowse repository at this point

• fix: remove redundant broadcast in fsdp vllm postprocess (#577)

  Show description for f7e183e
  wuxibin89

  authored
  f7e183eView commit details

  Copy full SHA for f7e183e

  View code at this pointBrowse repository at this point

• fix: remove redundant torch.cuda.empty_cache() (#575)

  Show description for 3fc3e2b
  wuxibin89

  authored
  3fc3e2bView commit details

  Copy full SHA for 3fc3e2b

  View code at this pointBrowse repository at this point

• [bugfix] fix: generation script (#542)

  Show description for 79e072f
  nwiad

  authored
  79e072fView commit details

  Copy full SHA for 79e072f

  View code at this pointBrowse repository at this point

• [rollout] feat: support sampling in validation stage (#553)

  Show description for d5de9f4
  PeterSH6

  authored
  d5de9f4View commit details

  Copy full SHA for d5de9f4

  View code at this pointBrowse repository at this point

Commits on Mar 12, 2025

• [misc] add assertion for normalized ppo_mini_batch_size (#552)

  Zeetc

  authored
  39b008dView commit details

  Copy full SHA for 39b008d

  View code at this pointBrowse repository at this point