Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 5, 2025

• [misc] refactor: refactor config, add grpo ci (#204)

  Show description for ac9d246
  vermouth1992

  authored
  ac9d246View commit details

  Copy full SHA for ac9d246

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Feb 1, 2025

• data: fix the math dataset source (#175)

  Show description for 677e120
  eric-haibin-lin

  authored
  677e120View commit details

  Copy full SHA for 677e120

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• [feat, SFT] Support LigerKernel for SFT (#173)

  xingyaoww

  authored
  25fc194View commit details

  Copy full SHA for 25fc194

  View code at this pointBrowse repository at this point

Commits on Jan 30, 2025

• Allow users to pass in custom compute_score function (#162)

  Show description for ce862ce
  corbt

  authored
  ce862ceView commit details

  Copy full SHA for ce862ce

  View code at this pointBrowse repository at this point

Commits on Jan 29, 2025

• fix: redundant non_zero_mask (#152)

  Show description for f9784cd
  emergenz

  authored
  f9784cdView commit details

  Copy full SHA for f9784cd

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] feat: enable grad ckpt as default and enable chunk prefill as default (#147)

  PeterSH6

  authored
  9fca71dView commit details

  Copy full SHA for 9fca71d

  View code at this pointBrowse repository at this point

• [misc] fix: gradient accumulation in seq balance and modify default vllm log level (#141)

  Show description for 695bdbb
  PeterSH6

  authored
  695bdbbView commit details

  Copy full SHA for 695bdbb

  View code at this pointBrowse repository at this point

• [SFT] Support context parallelism for SFT (#132)

  Show description for 077173f
  

  3 peopleauthored
  077173fView commit details

  Copy full SHA for 077173f

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 24, 2025

• [ppo] refactor: refactor old_log_prob into a separate function (#129)

  vermouth1992

  authored
  e974fb1View commit details

  Copy full SHA for e974fb1

  View code at this pointBrowse repository at this point

• [ci] feat: add ci for sft trainer (#128)

  Show description for fac99fa
  PeterSH6

  authored
  fac99faView commit details

  Copy full SHA for fac99fa

  View code at this pointBrowse repository at this point

• [perf] feat: support ref/rm offload (#121)

  Show description for fefca41
  vermouth1992

  authored
  fefca41View commit details

  Copy full SHA for fefca41

  View code at this pointBrowse repository at this point

• Revert "support using iteration to control the sft"

  Show description for 2f1be79
  PeterSH6

  committed
  2f1be79View commit details

  Copy full SHA for 2f1be79

  View code at this pointBrowse repository at this point

• support using iteration to control the sft

  PeterSH6

  committed
  1984094View commit details

  Copy full SHA for 1984094

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

Commits on Jan 22, 2025

• [perf] enable multiproc dataloader in sft trainer (#122)

  Show description for e611979
  hiyouga

  authored
  e611979View commit details

  Copy full SHA for e611979

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

• [misc] fix: super tiny fix mlflow error (#120)

  Show description for b43dcd9
  fzyzcjy

  authored
  b43dcd9View commit details

  Copy full SHA for b43dcd9

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2025

• [misc] feat: support mfu calculation (#117)

  vermouth1992

  authored
  41f645dView commit details

  Copy full SHA for 41f645d

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [perf] fix: set use_reentrant=False when enable gradient checkpointing (#114)

  Show description for 5a94e14
  vermouth1992

  authored
  5a94e14View commit details

  Copy full SHA for 5a94e14

  View code at this pointBrowse repository at this point

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

Commits on Jan 17, 2025

• [misc] chore: refactor and add several metrics (#111)

  Show description for 018b0d7
  vermouth1992

  authored
  018b0d7View commit details

  Copy full SHA for 018b0d7

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2025

• [misc] fix: fix license (#110)

  Show description for a33a3ba
  vermouth1992

  authored
  a33a3baView commit details

  Copy full SHA for a33a3ba

  View code at this pointBrowse repository at this point

Commits on Jan 14, 2025

• Fix loss value for gradient accumulation > 1 (#102)

  hiyouga

  authored
  e230de8View commit details

  Copy full SHA for e230de8

  View code at this pointBrowse repository at this point

Commits on Jan 13, 2025

• [misc] fix reward model issue with TokenClassification model and support running particular steps instead of epochs (#99)

  Show description for a0e8ed2
  PeterSH6

  authored
  a0e8ed2View commit details

  Copy full SHA for a0e8ed2

  View code at this pointBrowse repository at this point

Commits on Jan 11, 2025

• [misc] feat: spport rmpad/data-packing in FSDP with transformers (#91)

  Show description for 569210e
  PeterSH6

  authored
  569210eView commit details

  Copy full SHA for 569210e

  View code at this pointBrowse repository at this point

Commits on Jan 9, 2025

• fix validation dp_size (#90)

  vermouth1992

  authored
  5019131View commit details

  Copy full SHA for 5019131

  View code at this pointBrowse repository at this point

• [ci] feat: add more CI workflow (#38)

  Show description for c7bd252
  PeterSH6

  authored
  c7bd252View commit details

  Copy full SHA for c7bd252

  View code at this pointBrowse repository at this point

Commits on Jan 5, 2025

• [rollout] feat: support best-of-n generation in vLLM (#80)

  PeterSH6

  authored
  2997e5dView commit details

  Copy full SHA for 2997e5d

  View code at this pointBrowse repository at this point

Commits on Jan 2, 2025

• Support Mlflow, allow forward to have different batch size, compute more metrics (#74)

  Show description for 2856be4
  fzyzcjy

  authored
  2856be4View commit details

  Copy full SHA for 2856be4

  View code at this pointBrowse repository at this point

Commits on Dec 30, 2024

• [misc] fix: weak reference of WorkerDict in RayTrainer (#65)

  Show description for 94f4ca0
  PeterSH6

  authored
  94f4ca0View commit details

  Copy full SHA for 94f4ca0

  View code at this pointBrowse repository at this point

Commits on Dec 22, 2024

• fix response_mask index (#60)

  huiyeruzhou

  authored
  d46eb7dView commit details

  Copy full SHA for d46eb7d

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2024

• [misc] feat: remove @ray.remote on workers to allow inheritance (#61)

  Show description for 99d2c19
  

  PeterSH6

  and

  eric-haibin-lin

  authored
  99d2c19View commit details

  Copy full SHA for 99d2c19

  View code at this pointBrowse repository at this point