Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 25, 2025

• [Fix] Using an enumeration class to avoid spelling errors in adv_estimator

  

  Thom

  authored and

  Thom

  committed
  eeae051View commit details

  Copy full SHA for eeae051

  View code at this pointBrowse repository at this point

Commits on Feb 24, 2025

• [fix] Improve the params template for generation (#351)

  Show description for e53dcdb
  BearBiscuit05

  authored
  e53dcdbView commit details

  Copy full SHA for e53dcdb

  View code at this pointBrowse repository at this point

• [Fix] Deprecate `val_batch_size` (#353)

  Show description for 4011f40
  tongyx361

  authored
  4011f40View commit details

  Copy full SHA for 4011f40

  View code at this pointBrowse repository at this point

Commits on Feb 22, 2025

• algo: Rloo advantage estimator (#341)

  Show description for 6a820b6
  ZefanW

  authored
  6a820b6View commit details

  Copy full SHA for 6a820b6

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2025

• [misc] feat: support offload parameter and optimizer during rollout (#284)

  Show description for 9db5232
  PeterSH6

  authored
  9db5232View commit details

  Copy full SHA for 9db5232

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2025

• feat: Expose `remove_previous_ckpt` option to training entry point an… (#274)

  Show description for f3afdb3
  zwhe99

  authored
  f3afdb3View commit details

  Copy full SHA for f3afdb3

  View code at this pointBrowse repository at this point

• Add auto save ckpt at the end of training (#260)

  Show description for 8003e87
  YSLIU627

  authored
  8003e87View commit details

  Copy full SHA for 8003e87

  View code at this pointBrowse repository at this point

Commits on Feb 10, 2025

• [misc] feat: give main_task num_cpus=1 (#244)

  Show description for bf9be15
  vermouth1992

  authored
  bf9be15View commit details

  Copy full SHA for bf9be15

  View code at this pointBrowse repository at this point

• Feature/add remax support (#234)

  Show description for 769b8d0
  liziniu

  authored
  769b8d0View commit details

  Copy full SHA for 769b8d0

  View code at this pointBrowse repository at this point

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  View code at this pointBrowse repository at this point

• clean unused package . (#239)

  Show description for 7e07349
  

  湛露先生

  authored
  7e07349View commit details

  Copy full SHA for 7e07349

  View code at this pointBrowse repository at this point

Commits on Feb 9, 2025

• [misc]: fix ci and add warning to make sure wandb is used when logging val results (#237)

  Show description for 3d566ad
  PeterSH6

  authored
  3d566adView commit details

  Copy full SHA for 3d566ad

  View code at this pointBrowse repository at this point

• Add option to log validation generations to wandb (#177)

  Show description for d0725a6
  corbt

  authored
  d0725a6View commit details

  Copy full SHA for d0725a6

  View code at this pointBrowse repository at this point

• implement REINFORCE++ algorithm (#228)

  Show description for bdb50ac
  4332001876

  authored
  bdb50acView commit details

  Copy full SHA for bdb50ac

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  View code at this pointBrowse repository at this point

Commits on Feb 5, 2025

• [misc] refactor: refactor config, add grpo ci (#204)

  Show description for ac9d246
  vermouth1992

  authored
  ac9d246View commit details

  Copy full SHA for ac9d246

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Feb 1, 2025

• data: fix the math dataset source (#175)

  Show description for 677e120
  eric-haibin-lin

  authored
  677e120View commit details

  Copy full SHA for 677e120

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• [feat, SFT] Support LigerKernel for SFT (#173)

  xingyaoww

  authored
  25fc194View commit details

  Copy full SHA for 25fc194

  View code at this pointBrowse repository at this point

Commits on Jan 30, 2025

• Allow users to pass in custom compute_score function (#162)

  Show description for ce862ce
  corbt

  authored
  ce862ceView commit details

  Copy full SHA for ce862ce

  View code at this pointBrowse repository at this point

Commits on Jan 29, 2025

• fix: redundant non_zero_mask (#152)

  Show description for f9784cd
  emergenz

  authored
  f9784cdView commit details

  Copy full SHA for f9784cd

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] feat: enable grad ckpt as default and enable chunk prefill as default (#147)

  PeterSH6

  authored
  9fca71dView commit details

  Copy full SHA for 9fca71d

  View code at this pointBrowse repository at this point

• [misc] fix: gradient accumulation in seq balance and modify default vllm log level (#141)

  Show description for 695bdbb
  PeterSH6

  authored
  695bdbbView commit details

  Copy full SHA for 695bdbb

  View code at this pointBrowse repository at this point

• [SFT] Support context parallelism for SFT (#132)

  Show description for 077173f
  

  3 peopleauthored
  077173fView commit details

  Copy full SHA for 077173f

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 24, 2025

• [ppo] refactor: refactor old_log_prob into a separate function (#129)

  vermouth1992

  authored
  e974fb1View commit details

  Copy full SHA for e974fb1

  View code at this pointBrowse repository at this point

• [ci] feat: add ci for sft trainer (#128)

  Show description for fac99fa
  PeterSH6

  authored
  fac99faView commit details

  Copy full SHA for fac99fa

  View code at this pointBrowse repository at this point

• [perf] feat: support ref/rm offload (#121)

  Show description for fefca41
  vermouth1992

  authored
  fefca41View commit details

  Copy full SHA for fefca41

  View code at this pointBrowse repository at this point

• Revert "support using iteration to control the sft"

  Show description for 2f1be79
  PeterSH6

  committed
  2f1be79View commit details

  Copy full SHA for 2f1be79

  View code at this pointBrowse repository at this point

• support using iteration to control the sft

  PeterSH6

  committed
  1984094View commit details

  Copy full SHA for 1984094

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

Commits on Jan 22, 2025

• [perf] enable multiproc dataloader in sft trainer (#122)

  Show description for e611979
  hiyouga

  authored
  e611979View commit details

  Copy full SHA for e611979

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

• [misc] fix: super tiny fix mlflow error (#120)

  Show description for b43dcd9
  fzyzcjy

  authored
  b43dcd9View commit details

  Copy full SHA for b43dcd9

  View code at this pointBrowse repository at this point