Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Feb 23, 2025

• feat: tracking support vemlp (#339)

  Show description for 7a128c1
  

  liudayuan-carrot

  and

  liudayuan.carrot

  authored
  7a128c1View commit details

  Copy full SHA for 7a128c1

  View code at this pointBrowse repository at this point

• chore: update optimizer_config.py (#348)

  eltociear

  authored
  32a3d62View commit details

  Copy full SHA for 32a3d62

  View code at this pointBrowse repository at this point

Commits on Feb 19, 2025

• [megatron] feat: support qwen2 megatron backend (#261)

  Show description for 9448762
  kinman0224

  authored
  9448762View commit details

  Copy full SHA for 9448762

  View code at this pointBrowse repository at this point

Commits on Feb 18, 2025

• fix: fix offload/load optimizer impl (#299)

  Show description for cf54dd1
  Mofan-Z

  authored
  cf54dd1View commit details

  Copy full SHA for cf54dd1

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2025

• Fix wrongs args desc . (#294)

  Show description for 0dfcb7f
  

  湛露先生

  authored
  0dfcb7fView commit details

  Copy full SHA for 0dfcb7f

  View code at this pointBrowse repository at this point

• [misc] feat: support offload parameter and optimizer during rollout (#284)

  Show description for 9db5232
  PeterSH6

  authored
  9db5232View commit details

  Copy full SHA for 9db5232

  View code at this pointBrowse repository at this point

• Enhancement: Support for `extra_info` in Reward Calculation (#266)

  Show description for f0e5bdf
  maksimstw

  authored
  f0e5bdfView commit details

  Copy full SHA for f0e5bdf

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2025

• feat: Expose `remove_previous_ckpt` option to training entry point an… (#274)

  Show description for f3afdb3
  zwhe99

  authored
  f3afdb3View commit details

  Copy full SHA for f3afdb3

  View code at this pointBrowse repository at this point

Commits on Feb 14, 2025

• [testing][rollout] feat: support integration of vllm>=0.7.0 (spmd-version) (#209)

  Show description for f8b4d08
  ZSL98

  authored
  f8b4d08View commit details

  Copy full SHA for f8b4d08

  View code at this pointBrowse repository at this point

• fix the file lock issue (#255)

  Show description for 63f7513
  VPeterV

  authored
  63f7513View commit details

  Copy full SHA for 63f7513

  View code at this pointBrowse repository at this point

Commits on Feb 10, 2025

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  View code at this pointBrowse repository at this point

• clean unused package . (#239)

  Show description for 7e07349
  

  湛露先生

  authored
  7e07349View commit details

  Copy full SHA for 7e07349

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  View code at this pointBrowse repository at this point

• Memory efficiency improvement to logprobs_from_logits_v2 (#220)

  Show description for 4b51624
  tyler-romero

  authored
  4b51624View commit details

  Copy full SHA for 4b51624

  View code at this pointBrowse repository at this point

Commits on Feb 7, 2025

• [TRACKING] feat: Integrate SwanLab for experiment tracking with online/offline mode and local dashboard support (#218)

  Show description for 958a326
  ShaohonChen

  authored
  958a326View commit details

  Copy full SHA for 958a326

  View code at this pointBrowse repository at this point

• [rollout]: fix incorrect response_attention_mask in vLLM rollout (#213)

  Show description for 3140cc2
  kinman0224

  authored
  3140cc2View commit details

  Copy full SHA for 3140cc2

  View code at this pointBrowse repository at this point

• [misc] feat: add ckpt manager in utils (#216)

  Show description for 27484a7
  PeterSH6

  authored
  27484a7View commit details

  Copy full SHA for 27484a7

  View code at this pointBrowse repository at this point

Commits on Feb 5, 2025

• [misc] refactor: refactor config, add grpo ci (#204)

  Show description for ac9d246
  vermouth1992

  authored
  ac9d246View commit details

  Copy full SHA for ac9d246

  View code at this pointBrowse repository at this point

• assert to make sure flash-attn>=2.4.3 (#202)

  Show description for 49913bd
  bebetterest

  authored
  49913bdView commit details

  Copy full SHA for 49913bd

  View code at this pointBrowse repository at this point

Commits on Feb 4, 2025

• Call wandb.finish when the tracker is destructed if wandb is in use (#191)

  Show description for 483fa8a
  TonyLianLong

  authored
  483fa8aView commit details

  Copy full SHA for 483fa8a

  View code at this pointBrowse repository at this point

Commits on Feb 3, 2025

• megatron: fix config error and add compute log prob interface (#186)

  eric-haibin-lin

  authored
  818e4deView commit details

  Copy full SHA for 818e4de

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2025

• validate `use_remove_padding` when applying sequence parallelism (#153)

  chujiezheng

  authored
  fb3793aView commit details

  Copy full SHA for fb3793a

  View code at this pointBrowse repository at this point

Commits on Jan 27, 2025

• [BREAKING][misc] feat: change micro_batch_size to micro_batch_size_per_gpu (#136)

  Show description for f2a76ac
  PeterSH6

  authored
  f2a76acView commit details

  Copy full SHA for f2a76ac

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2025

• [SFT] feat: Add LoRA support for SFT (#127)

  Show description for 6d96fda
  

  3 peopleauthored
  6d96fdaView commit details

  Copy full SHA for 6d96fda

  View code at this pointBrowse repository at this point

Commits on Jan 23, 2025

• [perf] feat: support meta device init and parallel load for fsdp (#123)

  Show description for 884a727
  

  zhiqi-0

  and

  zhiqi.0

  authored
  884a727View commit details

  Copy full SHA for 884a727

  View code at this pointBrowse repository at this point

• [algo] feat: support GRPO algorithm (#124)

  Show description for cd52d8b
  PeterSH6

  authored
  cd52d8bView commit details

  Copy full SHA for cd52d8b

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2025

• [perf] feat: Support dynamic batch size (#118)

  Show description for 54051c8
  

  vermouth1992

  and

  PeterSH6

  authored
  54051c8View commit details

  Copy full SHA for 54051c8

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2025

• [misc] feat: support mfu calculation (#117)

  vermouth1992

  authored
  41f645dView commit details

  Copy full SHA for 41f645d

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2025

• [misc][Long Context] feat: support ulysses for long context training (#109)

  PeterSH6

  authored
  e8eb9e4View commit details

  Copy full SHA for e8eb9e4

  View code at this pointBrowse repository at this point

Commits on Jan 13, 2025

• [misc] feat: support different flash_attn versions with variable num returns (#100)

  Show description for 1facb9d
  PeterSH6

  authored
  1facb9dView commit details

  Copy full SHA for 1facb9d

  View code at this pointBrowse repository at this point

Commits on Jan 11, 2025

• [misc] feat: spport rmpad/data-packing in FSDP with transformers (#91)

  Show description for 569210e
  PeterSH6

  authored
  569210eView commit details

  Copy full SHA for 569210e

  View code at this pointBrowse repository at this point

Commits on Jan 2, 2025

• Support Mlflow, allow forward to have different batch size, compute more metrics (#74)

  Show description for 2856be4
  fzyzcjy

  authored
  2856be4View commit details

  Copy full SHA for 2856be4

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2024

• [ppo] chore: remove unused flash_attn dependency, and add docs for GSM8k reward (#55)

  Show description for cf01808
  eric-haibin-lin

  authored
  cf01808View commit details

  Copy full SHA for cf01808

  View code at this pointBrowse repository at this point

Commits on Dec 17, 2024

• [sft] feat: fix sft dataset with latest preprocess code (#49)

  Show description for d60f843
  eric-haibin-lin

  authored
  d60f843View commit details

  Copy full SHA for d60f843

  View code at this pointBrowse repository at this point

Commits on Dec 15, 2024

• api: rename tracking logger to wandb logger type (#47)

  eric-haibin-lin

  authored
  c2296e8View commit details

  Copy full SHA for c2296e8

  View code at this pointBrowse repository at this point