Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 25, 2025

• [Fix] Using an enumeration class to avoid spelling errors in adv_estimator

  

  Thom

  authored and

  Thom

  committed
  eeae051View commit details

  Copy full SHA for eeae051

  View code at this pointBrowse repository at this point

Commits on Feb 24, 2025

• [Fix] Deprecate `val_batch_size` (#353)

  Show description for 4011f40
  tongyx361

  authored
  4011f40View commit details

  Copy full SHA for 4011f40

  View code at this pointBrowse repository at this point

Commits on Feb 22, 2025

• algo: Rloo advantage estimator (#341)

  Show description for 6a820b6
  ZefanW

  authored
  6a820b6View commit details

  Copy full SHA for 6a820b6

  View code at this pointBrowse repository at this point

Commits on Feb 19, 2025

• [megatron] feat: support qwen2 megatron backend (#261)

  Show description for 9448762
  kinman0224

  authored
  9448762View commit details

  Copy full SHA for 9448762

  View code at this pointBrowse repository at this point

• docs: add an example for Ray on Slurm (#309)

  Show description for 55a4d3c
  danielz02

  authored
  55a4d3cView commit details

  Copy full SHA for 55a4d3c

  View code at this pointBrowse repository at this point

Commits on Feb 18, 2025

• example: fix the gemma2 example, update NGC dockerfile (#291)

  eric-haibin-lin

  authored
  77f065eView commit details

  Copy full SHA for 77f065e

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2025

• [misc] feat: support offload parameter and optimizer during rollout (#284)

  Show description for 9db5232
  PeterSH6

  authored
  9db5232View commit details

  Copy full SHA for 9db5232

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2025

• fix the split placement example (#281)

  Show description for c8b9c35
  xffxff

  authored
  c8b9c35View commit details

  Copy full SHA for c8b9c35

  View code at this pointBrowse repository at this point

Commits on Feb 10, 2025

• Feature/add remax support (#234)

  Show description for 769b8d0
  liziniu

  authored
  769b8d0View commit details

  Copy full SHA for 769b8d0

  View code at this pointBrowse repository at this point

Commits on Feb 9, 2025

• docs: add programming model guide (#230)

  eric-haibin-lin

  authored
  e842b73View commit details

  Copy full SHA for e842b73

  View code at this pointBrowse repository at this point

Commits on Feb 6, 2025

• example: switch the default model ckpt for Megatron, add wandb logs (#210)

  Show description for ced8ecb
  

  eric-haibin-lin

  and

  Your Name

  authored
  ced8ecbView commit details

  Copy full SHA for ced8ecb

  View code at this pointBrowse repository at this point

Commits on Feb 4, 2025

• Remove unused variable in gsm8k preprocessing code (#193)

  nch0w

  authored
  4d420feView commit details

  Copy full SHA for 4d420fe

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Feb 1, 2025

• data: fix the math dataset source (#175)

  Show description for 677e120
  eric-haibin-lin

  authored
  677e120View commit details

  Copy full SHA for 677e120

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• [feat, SFT] Support LigerKernel for SFT (#173)

  xingyaoww

  authored
  25fc194View commit details

  Copy full SHA for 25fc194

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] feat: enable grad ckpt as default and enable chunk prefill as default (#147)

  PeterSH6

  authored
  9fca71dView commit details

  Copy full SHA for 9fca71d

  View code at this pointBrowse repository at this point

• [SFT] Support context parallelism for SFT (#132)

  Show description for 077173f
  

  3 peopleauthored
  077173fView commit details

  Copy full SHA for 077173f

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

• [misc] fix: normalize batch size should divide sp size (#125)

  Show description for 5b90cd7
  PeterSH6

  authored
  5b90cd7View commit details

  Copy full SHA for 5b90cd7

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

Commits on Jan 13, 2025

• [misc] fix reward model issue with TokenClassification model and support running particular steps instead of epochs (#99)

  Show description for a0e8ed2
  PeterSH6

  authored
  a0e8ed2View commit details

  Copy full SHA for a0e8ed2

  View code at this pointBrowse repository at this point

Commits on Jan 11, 2025

• [example] fix: fix notebook link due to username update (#94)

  Show description for e08c428
  eric-haibin-lin

  authored
  e08c428View commit details

  Copy full SHA for e08c428

  View code at this pointBrowse repository at this point

• [example] docs: add getting started notebook with free GPUs from lightning (#92)

  eric-haibin-lin

  authored
  e6b089cView commit details

  Copy full SHA for e6b089c

  View code at this pointBrowse repository at this point

• [misc] feat: spport rmpad/data-packing in FSDP with transformers (#91)

  Show description for 569210e
  PeterSH6

  authored
  569210eView commit details

  Copy full SHA for 569210e

  View code at this pointBrowse repository at this point

Commits on Jan 9, 2025

• [docker] megatron: add TE to ngc dockerfile (#88)

  Show description for 7fa5b91
  eric-haibin-lin

  authored
  7fa5b91View commit details

  Copy full SHA for 7fa5b91

  View code at this pointBrowse repository at this point

Commits on Jan 8, 2025

• [misc] chore: remove useless files (#86)

  Show description for 138c8a5
  vermouth1992

  authored
  138c8a5View commit details

  Copy full SHA for 138c8a5

  View code at this pointBrowse repository at this point

Commits on Jan 5, 2025

• [rollout] feat: support best-of-n generation in vLLM (#80)

  PeterSH6

  authored
  2997e5dView commit details

  Copy full SHA for 2997e5d

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2024

• [misc] feat: remove @ray.remote on workers to allow inheritance (#61)

  Show description for 99d2c19
  

  PeterSH6

  and

  eric-haibin-lin

  authored
  99d2c19View commit details

  Copy full SHA for 99d2c19

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2024

• [BREAKING][refact]: move actor/critic/hybrid_engine/reward_model/rollout/workers out of ppo directory for reuse (#52)

  Show description for f535977
  PeterSH6

  authored
  f535977View commit details

  Copy full SHA for f535977

  View code at this pointBrowse repository at this point

Commits on Dec 17, 2024

• [sft] feat: fix sft dataset with latest preprocess code (#49)

  Show description for d60f843
  eric-haibin-lin

  authored
  d60f843View commit details

  Copy full SHA for d60f843

  View code at this pointBrowse repository at this point

Commits on Dec 15, 2024

• api: rename tracking logger to wandb logger type (#47)

  eric-haibin-lin

  authored
  c2296e8View commit details

  Copy full SHA for c2296e8

  View code at this pointBrowse repository at this point

Commits on Dec 11, 2024

• [BREAKING][core] move single_controller into verl directory (#45)

  Show description for cd6cef6
  PeterSH6

  authored
  cd6cef6View commit details

  Copy full SHA for cd6cef6

  View code at this pointBrowse repository at this point