Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Apr 7, 2025

• [distributed] enhancement: Make `register_center` named actor waiting time configurable & providing better error info (#947)

  Show description for c87e9f6
  

  hongpeng-guo

  and

  Copilot

  authored
  c87e9f6View commit details

  Copy full SHA for c87e9f6

  View code at this pointBrowse repository at this point

• [megatron] feat: add gradient checkpointing in megatron backend (#944)

  Show description for d13434f
  ccclyu

  authored
  d13434fView commit details

  Copy full SHA for d13434f

  View code at this pointBrowse repository at this point

• feat: Batch Rewards (#871)

  mertunsall

  authored
  82cbc43View commit details

  Copy full SHA for 82cbc43

  View code at this pointBrowse repository at this point

Commits on Apr 6, 2025

• [log] fix: validation metrics of reward and maj voting (#927)

  Show description for d2c6064
  tongyx361

  authored
  d2c6064View commit details

  Copy full SHA for d2c6064

  View code at this pointBrowse repository at this point

• [rf++] style: eos_mask to response_mask for reinforce++-baseline method (#938)

  Show description for 7afa6c6
  none0663

  authored
  7afa6c6View commit details

  Copy full SHA for 7afa6c6

  View code at this pointBrowse repository at this point

• fix: seq-mean-token-sum loss (#931)

  tongyx361

  authored
  4d722b1View commit details

  Copy full SHA for 4d722b1

  View code at this pointBrowse repository at this point

Commits on Apr 5, 2025

• Feat: support REINFORCE++-baseline and add script for REINFORCE++ (#908)

  Show description for 30259d2
  hijkzzz

  authored
  30259d2View commit details

  Copy full SHA for 30259d2

  View code at this pointBrowse repository at this point

Commits on Apr 4, 2025

• feat: Add multi-turn SFT support (#195)

  xingyaoww

  authored
  fb03941View commit details

  Copy full SHA for fb03941

  View code at this pointBrowse repository at this point

• [dataset] refactor: remove unused filter_prompts parameter from RLHFDataset (#889)

  Show description for 0407cad
  0x404

  authored
  0407cadView commit details

  Copy full SHA for 0407cad

  View code at this pointBrowse repository at this point

• fix: set gen_batch_size based on config (#909)

  tongyx361

  authored
  d5a1c81View commit details

  Copy full SHA for d5a1c81

  View code at this pointBrowse repository at this point

• [dataset] refactor: use hf Dataset instead of pandas DataFrame in RLHFDataset for speedup (#890)

  Show description for 6974bba
  

  0x404

  and

  hiyouga

  authored
  6974bbaView commit details

  Copy full SHA for 6974bba

  View code at this pointBrowse repository at this point

• [algo] misc: remove redundant tile([1, response_length]), efficient broadcast instead (#868)

  Show description for f9256b8
  dirtyDan0

  authored
  f9256b8View commit details

  Copy full SHA for f9256b8

  View code at this pointBrowse repository at this point

Commits on Apr 3, 2025

• [recipe] feat: integrate DAPO and provide reproduction script (#623)

  Show description for 3a27a98
  

  tongyx361

  and

  PeterSH6

  authored
  3a27a98View commit details

  Copy full SHA for 3a27a98

  View code at this pointBrowse repository at this point

• fix: misleading eos_mask->response_mask (#878)

  Show description for 8cae42d
  dirtyDan0

  authored
  8cae42dView commit details

  Copy full SHA for 8cae42d

  View code at this pointBrowse repository at this point

Commits on Apr 2, 2025

• [recipe] r1: support R1 Benchmark Evaluation (#777)

  Show description for 233c11c
  yyDing1

  authored
  233c11cView commit details

  Copy full SHA for 233c11c

  View code at this pointBrowse repository at this point

• Implement Dual-Clip PPO Algorithm (#784)

  Show description for 6272b8c
  none0663

  authored
  6272b8cView commit details

  Copy full SHA for 6272b8c

  View code at this pointBrowse repository at this point

Commits on Apr 1, 2025

• [misc] add trust_remote_code param for loading custom tokenizer (#865)

  BearBiscuit05

  authored
  05bdeadView commit details

  Copy full SHA for 05bdead

  View code at this pointBrowse repository at this point

• [critic] fix: normalize mini batch size for critic (#853)

  Show description for 9dcac14
  tongyx361

  authored
  9dcac14View commit details

  Copy full SHA for 9dcac14

  View code at this pointBrowse repository at this point

• feat: support no reference model; fix KL issues (#644)

  Show description for 072fc9f
  dirtyDan0

  authored
  072fc9fView commit details

  Copy full SHA for 072fc9f

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2025

• [ulysses] fix: repeat kv heads by sp_size//nheads_k if nheads_k is less than sp_size (#850)

  wuxibin89

  authored
  c0621e1View commit details

  Copy full SHA for c0621e1

  View code at this pointBrowse repository at this point

• [BREAKING] feat: support custom datasets for SFT trainer (#832)

  Show description for 77babf1
  eric-haibin-lin

  authored
  77babf1View commit details

  Copy full SHA for 77babf1

  View code at this pointBrowse repository at this point

• [doc] feat: doc for val_before_train (#840)

  tongyx361

  authored
  816daccView commit details

  Copy full SHA for 816dacc

  View code at this pointBrowse repository at this point

• [BREAKING config] fix: move val_before_train to config yaml. Using trainer.val_before_train instead of +trainer.val_before_train going forward (#820)

  tongyx361

  authored
  64bddb6View commit details

  Copy full SHA for 64bddb6

  View code at this pointBrowse repository at this point

Commits on Mar 30, 2025

• [BREAKING config] feat: add mlflow val generation log and uri config (#822)

  Show description for 7fbf609
  ccclyu

  authored
  7fbf609View commit details

  Copy full SHA for 7fbf609

  View code at this pointBrowse repository at this point

• Megatron checkpoint default not save hf_models, and provide model merge tool. (#780)

  Show description for ccab836
  ETOgaosion

  authored
  ccab836View commit details

  Copy full SHA for ccab836

  View code at this pointBrowse repository at this point

Commits on Mar 29, 2025

• docs: update checkpoint doc (#800)

  Show description for 50cba4a
  ETOgaosion

  authored
  50cba4aView commit details

  Copy full SHA for 50cba4a

  View code at this pointBrowse repository at this point

Commits on Mar 28, 2025

• [trainer] fix: skip the update step when encountering gradient overflow (#789)

  Show description for 093e959
  zhao9797

  authored
  093e959View commit details

  Copy full SHA for 093e959

  View code at this pointBrowse repository at this point

Commits on Mar 27, 2025

• refactor: remove redundant response_mask computation (#792)

  tongyx361

  authored
  f09e365View commit details

  Copy full SHA for f09e365

  View code at this pointBrowse repository at this point

• prevent division by zero in SFT (#786)

  cpchenpi

  authored
  076acdfView commit details

  Copy full SHA for 076acdf

  View code at this pointBrowse repository at this point

Commits on Mar 26, 2025

• [Feat] add max_ckpt_to_keep for old ckpt removal (#724)

  Show description for afb9f9f
  guanning03

  authored
  afb9f9fView commit details

  Copy full SHA for afb9f9f

  View code at this pointBrowse repository at this point

Commits on Mar 25, 2025

• refactor: unify ulysses flash attention patch to avoid single model patches (#735)

  Show description for ab7b941
  wuxibin89

  authored
  ab7b941View commit details

  Copy full SHA for ab7b941

  View code at this pointBrowse repository at this point

• Add tqdm progress bar to RayPPOTrainer to visualize training progress (#615)

  Show description for 36c10bf
  

  BeSkyer

  and

  hiyouga

  authored
  36c10bfView commit details

  Copy full SHA for 36c10bf

  View code at this pointBrowse repository at this point

Commits on Mar 23, 2025

• [feat] Megatron checkpoint support for current Llama and Qwen models (#687)

  Show description for 5d0a7ea
  

  4 peopleauthored
  5d0a7eaView commit details

  Copy full SHA for 5d0a7ea

  View code at this pointBrowse repository at this point

• Fix checkpoint loading in fsdp_checkpoint_manager.py and ray_trainer.py (#712)

  haoy-zzz

  authored
  c523a31View commit details

  Copy full SHA for c523a31

  View code at this pointBrowse repository at this point

Commits on Mar 21, 2025

• [Bug Fix] Fix SGLang rollout error under multi node (#652)

  ocss884

  authored
  612823aView commit details

  Copy full SHA for 612823a

  View code at this pointBrowse repository at this point