Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 24, 2025

• feat: add support for ulysses sequence parallel for transformers >= 0.48 (#357)

  Show description for d36422b
  xffxff

  authored
  d36422bView commit details

  Copy full SHA for d36422b

  View code at this pointBrowse repository at this point

• [fix] Improve the params template for generation (#351)

  Show description for e53dcdb
  BearBiscuit05

  authored
  e53dcdbView commit details

  Copy full SHA for e53dcdb

  View code at this pointBrowse repository at this point

Commits on Feb 20, 2025

• distro: bump up version to v0.2.0.dev, limit vllm version (#327)

  eric-haibin-lin

  authored
  0a1b16fView commit details

  Copy full SHA for 0a1b16f

  View code at this pointBrowse repository at this point

Commits on Feb 19, 2025

• [megatron] feat: support qwen2 megatron backend (#261)

  Show description for 9448762
  kinman0224

  authored
  9448762View commit details

  Copy full SHA for 9448762

  View code at this pointBrowse repository at this point

• fix: specify the hash version of action in scorecard.yml (#313)

  WillemJiang

  authored
  39d175bView commit details

  Copy full SHA for 39d175b

  View code at this pointBrowse repository at this point

• Added the dependabot action (#304)

  WillemJiang

  authored
  6856479View commit details

  Copy full SHA for 6856479

  View code at this pointBrowse repository at this point

• Added content permissions of the workflow (#303)

  Show description for dd09d47
  WillemJiang

  authored
  dd09d47View commit details

  Copy full SHA for dd09d47

  View code at this pointBrowse repository at this point

Commits on Feb 16, 2025

• distro: make liger-kernel optional. do not rely on requirement.txt during setup (#286)

  eric-haibin-lin

  authored
  0c32cf7View commit details

  Copy full SHA for 0c32cf7

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2025

• [misc] fix install requirement (#279)

  Show description for f1e13a6
  PeterSH6

  authored
  f1e13a6View commit details

  Copy full SHA for f1e13a6

  View code at this pointBrowse repository at this point

Commits on Feb 14, 2025

• [testing][rollout] feat: support integration of vllm>=0.7.0 (spmd-version) (#209)

  Show description for f8b4d08
  ZSL98

  authored
  f8b4d08View commit details

  Copy full SHA for f8b4d08

  View code at this pointBrowse repository at this point

• [ci] fix: delete ckpts after saving in github runner (#272)

  Show description for 62e23ae
  PeterSH6

  authored
  62e23aeView commit details

  Copy full SHA for 62e23ae

  View code at this pointBrowse repository at this point

Commits on Feb 10, 2025

• Feature/add remax support (#234)

  Show description for 769b8d0
  liziniu

  authored
  769b8d0View commit details

  Copy full SHA for 769b8d0

  View code at this pointBrowse repository at this point

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  View code at this pointBrowse repository at this point

Commits on Feb 7, 2025

• [misc] feat: add ckpt manager in utils (#216)

  Show description for 27484a7
  PeterSH6

  authored
  27484a7View commit details

  Copy full SHA for 27484a7

  View code at this pointBrowse repository at this point

Commits on Feb 6, 2025

• Create scorecard.yml for security scan (#215)

  Show description for ee23b7b
  willem-bd

  authored
  ee23b7bView commit details

  Copy full SHA for ee23b7b

  View code at this pointBrowse repository at this point

Commits on Feb 5, 2025

• [misc] refactor: refactor config, add grpo ci (#204)

  Show description for ac9d246
  vermouth1992

  authored
  ac9d246View commit details

  Copy full SHA for ac9d246

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• [feat, SFT] Support LigerKernel for SFT (#173)

  xingyaoww

  authored
  25fc194View commit details

  Copy full SHA for 25fc194

  View code at this pointBrowse repository at this point

Commits on Jan 30, 2025

• [Liger-kernel] Add an option to use `_apply_liger_kernel_to_instance()` to load model (#133)

  Show description for dd41877
  hongpeng-guo

  authored
  dd41877View commit details

  Copy full SHA for dd41877

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [misc] fix: gradient accumulation in seq balance and modify default vllm log level (#141)

  Show description for 695bdbb
  PeterSH6

  authored
  695bdbbView commit details

  Copy full SHA for 695bdbb

  View code at this pointBrowse repository at this point

• [SFT] Support context parallelism for SFT (#132)

  Show description for 077173f
  

  3 peopleauthored
  077173fView commit details

  Copy full SHA for 077173f

  View code at this pointBrowse repository at this point

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 24, 2025

• [ci] feat: add ci for sft trainer (#128)

  Show description for fac99fa
  PeterSH6

  authored
  fac99faView commit details

  Copy full SHA for fac99fa

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

• [ci] fix: change VLLM_ATTENTION_BACKEND to XFORMERS to avoid illegal memory access (#113)

  vermouth1992

  authored
  594d80aView commit details

  Copy full SHA for 594d80a

  View code at this pointBrowse repository at this point

Commits on Jan 17, 2025

• [ci] fix: add force stop in ray e2e ci to clean env (#112)

  Show description for ff0c7cc
  PeterSH6

  authored
  ff0c7ccView commit details

  Copy full SHA for ff0c7cc

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2025

• [misc] fix: fix license (#110)

  Show description for a33a3ba
  vermouth1992

  authored
  a33a3baView commit details

  Copy full SHA for a33a3ba

  View code at this pointBrowse repository at this point

Commits on Jan 13, 2025

• [misc] feat: support different flash_attn versions with variable num returns (#100)

  Show description for 1facb9d
  PeterSH6

  authored
  1facb9dView commit details

  Copy full SHA for 1facb9d

  View code at this pointBrowse repository at this point

• [misc] fix reward model issue with TokenClassification model and support running particular steps instead of epochs (#99)

  Show description for a0e8ed2
  PeterSH6

  authored
  a0e8ed2View commit details

  Copy full SHA for a0e8ed2

  View code at this pointBrowse repository at this point

Commits on Jan 11, 2025

• [misc] feat: spport rmpad/data-packing in FSDP with transformers (#91)

  Show description for 569210e
  PeterSH6

  authored
  569210eView commit details

  Copy full SHA for 569210e

  View code at this pointBrowse repository at this point

Commits on Jan 9, 2025

• [ci] feat: add more CI workflow (#38)

  Show description for c7bd252
  PeterSH6

  authored
  c7bd252View commit details

  Copy full SHA for c7bd252

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2024

• [install] fix: revert pyproj.toml and fix tensordict req (#59)

  Show description for 09568e6
  eric-haibin-lin

  authored
  09568e6View commit details

  Copy full SHA for 09568e6

  View code at this pointBrowse repository at this point