Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Jan 29, 2025

• fix: redundant non_zero_mask (#152)

  Show description for f9784cd
  emergenz

  authored
  f9784cdView commit details

  Copy full SHA for f9784cd

  View code at this pointBrowse repository at this point

• fix: fix missing version file dependency when installing without -e (#156)

  eric-haibin-lin

  authored
  e3cc0ebView commit details

  Copy full SHA for e3cc0eb

  View code at this pointBrowse repository at this point

Commits on Jan 28, 2025

• [misc]fix: pad dataproto when pad size is larger than len(dataproto) (#150)

  Show description for ab525bc
  

  PeterSH6

  and

  vermouth1992

  authored
  ab525bcView commit details

  Copy full SHA for ab525bc

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] feat: enable grad ckpt as default and enable chunk prefill as default (#147)

  PeterSH6

  authored
  9fca71dView commit details

  Copy full SHA for 9fca71d

  View code at this pointBrowse repository at this point

• [misc] fix: gradient accumulation in seq balance and modify default vllm log level (#141)

  Show description for 695bdbb
  PeterSH6

  authored
  695bdbbView commit details

  Copy full SHA for 695bdbb

  View code at this pointBrowse repository at this point

• [SFT] Support context parallelism for SFT (#132)

  Show description for 077173f
  

  3 peopleauthored
  077173fView commit details

  Copy full SHA for 077173f

  View code at this pointBrowse repository at this point

• [VLLM] Set max_num_batched_tokens for vllm rollout (#140)

  Show description for c99df03
  xingyaoww

  authored
  c99df03View commit details

  Copy full SHA for c99df03

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

• [misc] fix: only return old_log_prob and temp to fix union problem in old_log_prob (#137)

  Show description for 8bf9b95
  PeterSH6

  authored
  8bf9b95View commit details

  Copy full SHA for 8bf9b95

  View code at this pointBrowse repository at this point

Commits on Jan 26, 2025

• [misc] fix nan in non_tensor_batch union (#135)

  PeterSH6

  authored
  23101c3View commit details

  Copy full SHA for 23101c3

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 24, 2025

• [ppo] refactor: refactor old_log_prob into a separate function (#129)

  vermouth1992

  authored
  e974fb1View commit details

  Copy full SHA for e974fb1

  View code at this pointBrowse repository at this point

• [ci] feat: add ci for sft trainer (#128)

  Show description for fac99fa
  PeterSH6

  authored
  fac99faView commit details

  Copy full SHA for fac99fa

  View code at this pointBrowse repository at this point

• [perf] feat: support ref/rm offload (#121)

  Show description for fefca41
  vermouth1992

  authored
  fefca41View commit details

  Copy full SHA for fefca41

  View code at this pointBrowse repository at this point

• Revert "support using iteration to control the sft"

  Show description for 2f1be79
  PeterSH6

  committed
  2f1be79View commit details

  Copy full SHA for 2f1be79

  View code at this pointBrowse repository at this point

• support using iteration to control the sft

  PeterSH6

  committed
  1984094View commit details

  Copy full SHA for 1984094

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [perf] feat: support meta device init and parallel load for fsdp (#123)

  Show description for 884a727
  

  zhiqi-0

  and

  zhiqi.0

  authored
  884a727View commit details

  Copy full SHA for 884a727

  View code at this pointBrowse repository at this point

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

• [misc] fix: normalize batch size should divide sp size (#125)

  Show description for 5b90cd7
  PeterSH6

  authored
  5b90cd7View commit details

  Copy full SHA for 5b90cd7

  View code at this pointBrowse repository at this point

Commits on Jan 22, 2025

• [perf] enable multiproc dataloader in sft trainer (#122)

  Show description for e611979
  hiyouga

  authored
  e611979View commit details

  Copy full SHA for e611979

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

• [misc] fix: super tiny fix mlflow error (#120)

  Show description for b43dcd9
  fzyzcjy

  authored
  b43dcd9View commit details

  Copy full SHA for b43dcd9

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2025

• [misc] feat: support mfu calculation (#117)

  vermouth1992

  authored
  41f645dView commit details

  Copy full SHA for 41f645d

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [dataproto] fix: add assertion for uneven chunk (#115)

  Show description for 1ec5eb5
  vermouth1992

  authored
  1ec5eb5View commit details

  Copy full SHA for 1ec5eb5

  View code at this pointBrowse repository at this point

• [perf] fix: set use_reentrant=False when enable gradient checkpointing (#114)

  Show description for 5a94e14
  vermouth1992

  authored
  5a94e14View commit details

  Copy full SHA for 5a94e14

  View code at this pointBrowse repository at this point

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

Commits on Jan 17, 2025

• [misc] chore: refactor and add several metrics (#111)

  Show description for 018b0d7
  vermouth1992

  authored
  018b0d7View commit details

  Copy full SHA for 018b0d7

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2025

• [misc] fix: fix license (#110)

  Show description for a33a3ba
  vermouth1992

  authored
  a33a3baView commit details

  Copy full SHA for a33a3ba

  View code at this pointBrowse repository at this point

Commits on Jan 14, 2025

• refact: hybrid_engine dir to sharding_manager for more general representation (#103)

  PeterSH6

  authored
  6a9f6e1View commit details

  Copy full SHA for 6a9f6e1

  View code at this pointBrowse repository at this point

• Fix loss value for gradient accumulation > 1 (#102)

  hiyouga

  authored
  e230de8View commit details

  Copy full SHA for e230de8

  View code at this pointBrowse repository at this point

Commits on Jan 13, 2025

• [misc] feat: support different flash_attn versions with variable num returns (#100)

  Show description for 1facb9d
  PeterSH6

  authored
  1facb9dView commit details

  Copy full SHA for 1facb9d

  View code at this pointBrowse repository at this point

• [misc] fix reward model issue with TokenClassification model and support running particular steps instead of epochs (#99)

  Show description for a0e8ed2
  PeterSH6

  authored
  a0e8ed2View commit details

  Copy full SHA for a0e8ed2

  View code at this pointBrowse repository at this point

Commits on Jan 11, 2025

• [misc] feat: spport rmpad/data-packing in FSDP with transformers (#91)

  Show description for 569210e
  PeterSH6

  authored
  569210eView commit details

  Copy full SHA for 569210e

  View code at this pointBrowse repository at this point

Commits on Jan 10, 2025

• [megatron] docs: clean up unused code, update megatron backend docs and installation docs (#89)

  Show description for e88cf81
  

  eric-haibin-lin

  and

  Your Name

  authored
  e88cf81View commit details

  Copy full SHA for e88cf81

  View code at this pointBrowse repository at this point

Commits on Jan 9, 2025

• fix validation dp_size (#90)

  vermouth1992

  authored
  5019131View commit details

  Copy full SHA for 5019131

  View code at this pointBrowse repository at this point