Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Feb 15, 2025

• [misc] fix install requirement (#279)

  Show description for f1e13a6
  PeterSH6

  authored
  f1e13a6View commit details

  Copy full SHA for f1e13a6

  Browse repository at this point

• Add auto save ckpt at the end of training (#260)

  Show description for 8003e87
  YSLIU627

  authored
  8003e87View commit details

  Copy full SHA for 8003e87

  Browse repository at this point

• Add model merger to save checkpoints in the format of .safetensor and push them to the huggingface (#262)

  Show description for 1703c34
  YSLIU627

  authored
  1703c34View commit details

  Copy full SHA for 1703c34

  Browse repository at this point

Commits on Feb 14, 2025

• clean 'WG_BACKEND' unused code. (#258)

  

  湛露先生

  authored
  58a5c46View commit details

  Copy full SHA for 58a5c46

  Browse repository at this point

• [testing][rollout] feat: support integration of vllm>=0.7.0 (spmd-version) (#209)

  Show description for f8b4d08
  ZSL98

  authored
  f8b4d08View commit details

  Copy full SHA for f8b4d08

  Browse repository at this point

• fix the file lock issue (#255)

  Show description for 63f7513
  VPeterV

  authored
  63f7513View commit details

  Copy full SHA for 63f7513

  Browse repository at this point

• [misc] Compatibility Issue with Python 3.9 in FSDP Worker for LLaMA Model (#268)

  Show description for 7346ecf
  uygnef

  authored
  7346ecfView commit details

  Copy full SHA for 7346ecf

  Browse repository at this point

• [ci] fix: delete ckpts after saving in github runner (#272)

  Show description for 62e23ae
  PeterSH6

  authored
  62e23aeView commit details

  Copy full SHA for 62e23ae

  Browse repository at this point

Commits on Feb 13, 2025

• [doc] feat: update remove_padding usage in perf tuning (#264)

  Show description for ec82e9e
  PeterSH6

  authored
  ec82e9eView commit details

  Copy full SHA for ec82e9e

  Browse repository at this point

Commits on Feb 12, 2025

• Update README.md to include critic-rl (#257)

  vermouth1992

  authored
  dbbf95cView commit details

  Copy full SHA for dbbf95c

  Browse repository at this point

• docs: fix remax algorithm table format (#254)

  eric-haibin-lin

  authored
  7651821View commit details

  Copy full SHA for 7651821

  Browse repository at this point

• Fix wrong code path in docs. (#256)

  

  湛露先生

  authored
  762c761View commit details

  Copy full SHA for 762c761

  Browse repository at this point

• docs: update upcoming features

  eric-haibin-lin

  authored
  c46f403View commit details

  Copy full SHA for c46f403

  Browse repository at this point

Commits on Feb 11, 2025

• docs: add deepscaler

  eric-haibin-lin

  authored
  607b493View commit details

  Copy full SHA for 607b493

  Browse repository at this point

• fix: Typo in the rank zero code (#240)

  Show description for 95560d7
  ExtremeViscent

  authored
  95560d7View commit details

  Copy full SHA for 95560d7

  Browse repository at this point

Commits on Feb 10, 2025

• [misc] feat: give main_task num_cpus=1 (#244)

  Show description for bf9be15
  vermouth1992

  authored
  bf9be15View commit details

  Copy full SHA for bf9be15

  Browse repository at this point

• Feature/add remax support (#234)

  Show description for 769b8d0
  liziniu

  authored
  769b8d0View commit details

  Copy full SHA for 769b8d0

  Browse repository at this point

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  Browse repository at this point

• fix: typo (#243)

  Show description for 16b1984
  

  湛露先生

  authored
  16b1984View commit details

  Copy full SHA for 16b1984

  Browse repository at this point

• clean unused package . (#239)

  Show description for 7e07349
  

  湛露先生

  authored
  7e07349View commit details

  Copy full SHA for 7e07349

  Browse repository at this point

Commits on Feb 9, 2025

• [misc]: fix ci and add warning to make sure wandb is used when logging val results (#237)

  Show description for 3d566ad
  PeterSH6

  authored
  3d566adView commit details

  Copy full SHA for 3d566ad

  Browse repository at this point

• delete redundant append_to_dict (#236)

  Show description for 6427f50
  Cppowboy

  authored
  6427f50View commit details

  Copy full SHA for 6427f50

  Browse repository at this point

• Add option to log validation generations to wandb (#177)

  Show description for d0725a6
  corbt

  authored
  d0725a6View commit details

  Copy full SHA for d0725a6

  Browse repository at this point

• [doc] fix document deprecated link (#235)

  Show description for 610c20c
  PeterSH6

  authored
  610c20cView commit details

  Copy full SHA for 610c20c

  Browse repository at this point

• add requirements (#231)

  Show description for 577a341
  ZefanW

  authored
  577a341View commit details

  Copy full SHA for 577a341

  Browse repository at this point

• docs: add programming model guide (#230)

  eric-haibin-lin

  authored
  e842b73View commit details

  Copy full SHA for e842b73

  Browse repository at this point

• implement REINFORCE++ algorithm (#228)

  Show description for bdb50ac
  4332001876

  authored
  bdb50acView commit details

  Copy full SHA for bdb50ac

  Browse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  Browse repository at this point

• Fix typo tips in bash sft. (#226)

  Show description for 62a065b
  

  湛露先生

  authored
  62a065bView commit details

  Copy full SHA for 62a065b

  Browse repository at this point

• Memory efficiency improvement to logprobs_from_logits_v2 (#220)

  Show description for 4b51624
  tyler-romero

  authored
  4b51624View commit details

  Copy full SHA for 4b51624

  Browse repository at this point

Commits on Feb 7, 2025

• [TRACKING] feat: Integrate SwanLab for experiment tracking with online/offline mode and local dashboard support (#218)

  Show description for 958a326
  ShaohonChen

  authored
  958a326View commit details

  Copy full SHA for 958a326

  Browse repository at this point

• [rollout]: fix incorrect response_attention_mask in vLLM rollout (#213)

  Show description for 3140cc2
  kinman0224

  authored
  3140cc2View commit details

  Copy full SHA for 3140cc2

  Browse repository at this point

• [misc] feat: add ckpt manager in utils (#216)

  Show description for 27484a7
  PeterSH6

  authored
  27484a7View commit details

  Copy full SHA for 27484a7

  Browse repository at this point

Commits on Feb 6, 2025

• Create scorecard.yml for security scan (#215)

  Show description for ee23b7b
  willem-bd

  authored
  ee23b7bView commit details

  Copy full SHA for ee23b7b

  Browse repository at this point

• example: switch the default model ckpt for Megatron, add wandb logs (#210)

  Show description for ced8ecb
  

  eric-haibin-lin

  and

  Your Name

  authored
  ced8ecbView commit details

  Copy full SHA for ced8ecb

  Browse repository at this point