Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Apr 7, 2025

• feat: Batch Rewards (#871)

  mertunsall

  authored
  82cbc43View commit details

  Copy full SHA for 82cbc43

  View code at this pointBrowse repository at this point

Commits on Apr 6, 2025

• [vllm] feat: enable FSDP and vLLM 0.8.2 to support DPSK v3 training. (#923)

  Show description for f8d1973
  BearBiscuit05

  authored
  f8d1973View commit details

  Copy full SHA for f8d1973

  View code at this pointBrowse repository at this point

Commits on Apr 4, 2025

• feat: Add multi-turn SFT support (#195)

  xingyaoww

  authored
  fb03941View commit details

  Copy full SHA for fb03941

  View code at this pointBrowse repository at this point

Commits on Apr 3, 2025

• [recipe] feat: integrate DAPO and provide reproduction script (#623)

  Show description for 3a27a98
  

  tongyx361

  and

  PeterSH6

  authored
  3a27a98View commit details

  Copy full SHA for 3a27a98

  View code at this pointBrowse repository at this point

• test: update vllm_spmd test for > 0.7.3 (#861)

  Show description for 1a7e53d
  BearBiscuit05

  authored
  1a7e53dView commit details

  Copy full SHA for 1a7e53d

  View code at this pointBrowse repository at this point

• reuse GPTModel, try to fix CI issue (#884)

  Show description for 0338805
  ETOgaosion

  authored
  0338805View commit details

  Copy full SHA for 0338805

  View code at this pointBrowse repository at this point

Commits on Apr 2, 2025

• [recipe] r1: support R1 Benchmark Evaluation (#777)

  Show description for 233c11c
  yyDing1

  authored
  233c11cView commit details

  Copy full SHA for 233c11c

  View code at this pointBrowse repository at this point

Commits on Apr 1, 2025

• feat: support no reference model; fix KL issues (#644)

  Show description for 072fc9f
  dirtyDan0

  authored
  072fc9fView commit details

  Copy full SHA for 072fc9f

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2025

• [ulysses] fix: repeat kv heads by sp_size//nheads_k if nheads_k is less than sp_size (#850)

  wuxibin89

  authored
  c0621e1View commit details

  Copy full SHA for c0621e1

  View code at this pointBrowse repository at this point

• [BREAKING] feat: support custom datasets for SFT trainer (#832)

  Show description for 77babf1
  eric-haibin-lin

  authored
  77babf1View commit details

  Copy full SHA for 77babf1

  View code at this pointBrowse repository at this point

• [BREAKING config] fix: move val_before_train to config yaml. Using trainer.val_before_train instead of +trainer.val_before_train going forward (#820)

  tongyx361

  authored
  64bddb6View commit details

  Copy full SHA for 64bddb6

  View code at this pointBrowse repository at this point

Commits on Mar 30, 2025

• Megatron checkpoint default not save hf_models, and provide model merge tool. (#780)

  Show description for ccab836
  ETOgaosion

  authored
  ccab836View commit details

  Copy full SHA for ccab836

  View code at this pointBrowse repository at this point

Commits on Mar 27, 2025

• doc: upgrade to vllm 0.8.2 (#769)

  hiyouga

  authored
  1b8b0e8View commit details

  Copy full SHA for 1b8b0e8

  View code at this pointBrowse repository at this point

Commits on Mar 25, 2025

• refactor: unify ulysses flash attention patch to avoid single model patches (#735)

  Show description for ab7b941
  wuxibin89

  authored
  ab7b941View commit details

  Copy full SHA for ab7b941

  View code at this pointBrowse repository at this point

Commits on Mar 23, 2025

• [feat] Megatron checkpoint support for current Llama and Qwen models (#687)

  Show description for 5d0a7ea
  

  4 peopleauthored
  5d0a7eaView commit details

  Copy full SHA for 5d0a7ea

  View code at this pointBrowse repository at this point

• Add GRPO CI to FSDP and Megatron simple e2e. (#711)

  Show description for 98a0208
  ETOgaosion

  authored
  98a0208View commit details

  Copy full SHA for 98a0208

  View code at this pointBrowse repository at this point

Commits on Mar 17, 2025

• [rollout] feat: add SGLang as rollout engine to verl (#490)

  Show description for 333e6d6
  

  ocss884

  and

  zhaochenyang20

  authored
  333e6d6View commit details

  Copy full SHA for 333e6d6

  View code at this pointBrowse repository at this point

Commits on Mar 11, 2025

• [misc] feat: support vllm>0.7 world size 1 generation (#520)

  PeterSH6

  authored
  be2c705View commit details

  Copy full SHA for be2c705

  View code at this pointBrowse repository at this point

Commits on Mar 10, 2025

• recipe: PRIME algorithm (#362)

  Show description for f0e7f9f
  ZefanW

  authored
  f0e7f9fView commit details

  Copy full SHA for f0e7f9f

  View code at this pointBrowse repository at this point

• [perf] fix: correct meta weight init error to support hsdp (#508)

  Show description for 872022d
  zhr2001

  authored
  872022dView commit details

  Copy full SHA for 872022d

  View code at this pointBrowse repository at this point

Commits on Mar 8, 2025

• feat: support loading reward function from an external file (#452)

  dirtyDan0

  authored
  13a87c7View commit details

  Copy full SHA for 13a87c7

  View code at this pointBrowse repository at this point

Commits on Mar 7, 2025

• Verl's megatron core_r0.11.0 backend successfully tested with 3D parallelism with multiple bug fixed (#495)

  Show description for 35555d8
  

  ETOgaosion

  and

  uygnef

  authored
  35555d8View commit details

  Copy full SHA for 35555d8

  View code at this pointBrowse repository at this point

Commits on Mar 6, 2025

• [misc] feat: add allgather method to dataproto (#497)

  Show description for 0cc2bda
  vermouth1992

  authored
  0cc2bdaView commit details

  Copy full SHA for 0cc2bda

  View code at this pointBrowse repository at this point

Commits on Mar 3, 2025

• [feat] Initial support for VLMs, add Qwen2.5VL GRPO example (#386)

  Show description for b46f55e
  hiyouga

  authored
  b46f55eView commit details

  Copy full SHA for b46f55e

  View code at this pointBrowse repository at this point

Commits on Mar 2, 2025

• rollout: FIRE sampling added. (#58)

  laonahongchen

  authored
  b677a61View commit details

  Copy full SHA for b677a61

  View code at this pointBrowse repository at this point

Commits on Feb 27, 2025

• [ci] fix: fix qwen0.5b megatron ci (#396)

  vermouth1992

  authored
  5964358View commit details

  Copy full SHA for 5964358

  View code at this pointBrowse repository at this point

Commits on Feb 26, 2025

• apis: add data proto to documentation page. use copy_to_local instead of copy_local_path_from_hdfs (#358)

  eric-haibin-lin

  authored
  2440aa6View commit details

  Copy full SHA for 2440aa6

  View code at this pointBrowse repository at this point

Commits on Feb 24, 2025

• feat: add support for ulysses sequence parallel for transformers >= 0.48 (#357)

  Show description for d36422b
  xffxff

  authored
  d36422bView commit details

  Copy full SHA for d36422b

  View code at this pointBrowse repository at this point

• [fix] Improve the params template for generation (#351)

  Show description for e53dcdb
  BearBiscuit05

  authored
  e53dcdbView commit details

  Copy full SHA for e53dcdb

  View code at this pointBrowse repository at this point

• [Fix] Deprecate `val_batch_size` (#353)

  Show description for 4011f40
  tongyx361

  authored
  4011f40View commit details

  Copy full SHA for 4011f40

  View code at this pointBrowse repository at this point

Commits on Feb 20, 2025

• distro: bump up version to v0.2.0.dev, limit vllm version (#327)

  eric-haibin-lin

  authored
  0a1b16fView commit details

  Copy full SHA for 0a1b16f

  View code at this pointBrowse repository at this point

Commits on Feb 19, 2025

• [megatron] feat: support qwen2 megatron backend (#261)

  Show description for 9448762
  kinman0224

  authored
  9448762View commit details

  Copy full SHA for 9448762

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2025

• [misc] feat: support offload parameter and optimizer during rollout (#284)

  Show description for 9db5232
  PeterSH6

  authored
  9db5232View commit details

  Copy full SHA for 9db5232

  View code at this pointBrowse repository at this point

Commits on Feb 16, 2025

• distro: make liger-kernel optional. do not rely on requirement.txt during setup (#286)

  eric-haibin-lin

  authored
  0c32cf7View commit details

  Copy full SHA for 0c32cf7

  View code at this pointBrowse repository at this point

Commits on Feb 14, 2025

• [testing][rollout] feat: support integration of vllm>=0.7.0 (spmd-version) (#209)

  Show description for f8b4d08
  ZSL98

  authored
  f8b4d08View commit details

  Copy full SHA for f8b4d08

  View code at this pointBrowse repository at this point