Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 25, 2025

• [ppo] fix: fix minibatch size when n > 1 for megatron worker (#370)

  vermouth1992

  authored
  bbda2e5View commit details

  Copy full SHA for bbda2e5

  View code at this pointBrowse repository at this point

Commits on Feb 24, 2025

• rollout: Fix navive_rollout class names. (#361)

  Show description for 656accb
  

  湛露先生

  authored
  656accbView commit details

  Copy full SHA for 656accb

  View code at this pointBrowse repository at this point

Commits on Feb 19, 2025

• [megatron] feat: support qwen2 megatron backend (#261)

  Show description for 9448762
  kinman0224

  authored
  9448762View commit details

  Copy full SHA for 9448762

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2025

• [misc] feat: support offload parameter and optimizer during rollout (#284)

  Show description for 9db5232
  PeterSH6

  authored
  9db5232View commit details

  Copy full SHA for 9db5232

  View code at this pointBrowse repository at this point

• Enhancement: Support for `extra_info` in Reward Calculation (#266)

  Show description for f0e5bdf
  maksimstw

  authored
  f0e5bdfView commit details

  Copy full SHA for f0e5bdf

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2025

• feat: Expose `remove_previous_ckpt` option to training entry point an… (#274)

  Show description for f3afdb3
  zwhe99

  authored
  f3afdb3View commit details

  Copy full SHA for f3afdb3

  View code at this pointBrowse repository at this point

Commits on Feb 14, 2025

• [testing][rollout] feat: support integration of vllm>=0.7.0 (spmd-version) (#209)

  Show description for f8b4d08
  ZSL98

  authored
  f8b4d08View commit details

  Copy full SHA for f8b4d08

  View code at this pointBrowse repository at this point

• [ci] fix: delete ckpts after saving in github runner (#272)

  Show description for 62e23ae
  PeterSH6

  authored
  62e23aeView commit details

  Copy full SHA for 62e23ae

  View code at this pointBrowse repository at this point

Commits on Feb 10, 2025

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  View code at this pointBrowse repository at this point

Commits on Feb 9, 2025

• delete redundant append_to_dict (#236)

  Show description for 6427f50
  Cppowboy

  authored
  6427f50View commit details

  Copy full SHA for 6427f50

  View code at this pointBrowse repository at this point

• add requirements (#231)

  Show description for 577a341
  ZefanW

  authored
  577a341View commit details

  Copy full SHA for 577a341

  View code at this pointBrowse repository at this point

• docs: add programming model guide (#230)

  eric-haibin-lin

  authored
  e842b73View commit details

  Copy full SHA for e842b73

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  View code at this pointBrowse repository at this point

Commits on Feb 7, 2025

• [rollout]: fix incorrect response_attention_mask in vLLM rollout (#213)

  Show description for 3140cc2
  kinman0224

  authored
  3140cc2View commit details

  Copy full SHA for 3140cc2

  View code at this pointBrowse repository at this point

Commits on Feb 5, 2025

• [misc] fix: load and offload in compute log prob (#208)

  Show description for 6872dbe
  PeterSH6

  authored
  6872dbeView commit details

  Copy full SHA for 6872dbe

  View code at this pointBrowse repository at this point

• fix critic save error (#199)

  Show description for 4669ab9
  WeiXiongUST

  authored
  4669ab9View commit details

  Copy full SHA for 4669ab9

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Feb 2, 2025

• exchange the mini_batch_size calculation logic (#183)

  chujiezheng

  authored
  6e003c0View commit details

  Copy full SHA for 6e003c0

  View code at this pointBrowse repository at this point

Commits on Feb 1, 2025

• [misc] fix: grpo kl loss should be add when do minimization (#179)

  Show description for a65c915
  PeterSH6

  authored
  a65c915View commit details

  Copy full SHA for a65c915

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• fix bug：fix checkpoint save with existing dirs (#174)

  Show description for 679798c
  

  dignfei

  and

  eric-haibin-lin

  authored
  679798cView commit details

  Copy full SHA for 679798c

  View code at this pointBrowse repository at this point

Commits on Jan 30, 2025

• [Liger-kernel] Add an option to use `_apply_liger_kernel_to_instance()` to load model (#133)

  Show description for dd41877
  hongpeng-guo

  authored
  dd41877View commit details

  Copy full SHA for dd41877

  View code at this pointBrowse repository at this point

• [nit] Explicitly show logits dimension in `dp_worker.py::forward_micro_batch` (#164)

  Show description for df03aa6
  hongpeng-guo

  authored
  df03aa6View commit details

  Copy full SHA for df03aa6

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] fix: gradient accumulation in seq balance and modify default vllm log level (#141)

  Show description for 695bdbb
  PeterSH6

  authored
  695bdbbView commit details

  Copy full SHA for 695bdbb

  View code at this pointBrowse repository at this point

• [VLLM] Set max_num_batched_tokens for vllm rollout (#140)

  Show description for c99df03
  xingyaoww

  authored
  c99df03View commit details

  Copy full SHA for c99df03

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

• [misc] fix: only return old_log_prob and temp to fix union problem in old_log_prob (#137)

  Show description for 8bf9b95
  PeterSH6

  authored
  8bf9b95View commit details

  Copy full SHA for 8bf9b95

  View code at this pointBrowse repository at this point

Commits on Jan 24, 2025

• [ppo] refactor: refactor old_log_prob into a separate function (#129)

  vermouth1992

  authored
  e974fb1View commit details

  Copy full SHA for e974fb1

  View code at this pointBrowse repository at this point

• [perf] feat: support ref/rm offload (#121)

  Show description for fefca41
  vermouth1992

  authored
  fefca41View commit details

  Copy full SHA for fefca41

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

• [misc] fix: normalize batch size should divide sp size (#125)

  Show description for 5b90cd7
  PeterSH6

  authored
  5b90cd7View commit details

  Copy full SHA for 5b90cd7

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2025

• [misc] feat: support mfu calculation (#117)

  vermouth1992

  authored
  41f645dView commit details

  Copy full SHA for 41f645d

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [perf] fix: set use_reentrant=False when enable gradient checkpointing (#114)

  Show description for 5a94e14
  vermouth1992

  authored
  5a94e14View commit details

  Copy full SHA for 5a94e14

  View code at this pointBrowse repository at this point

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

Commits on Jan 14, 2025

• refact: hybrid_engine dir to sharding_manager for more general representation (#103)

  PeterSH6

  authored
  6a9f6e1View commit details

  Copy full SHA for 6a9f6e1

  View code at this pointBrowse repository at this point