Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Feb 12, 2025

• Update README.md to include critic-rl (#257)

  vermouth1992

  authored
  dbbf95cView commit details

  Copy full SHA for dbbf95c

  Browse repository at this point

• docs: fix remax algorithm table format (#254)

  eric-haibin-lin

  authored
  7651821View commit details

  Copy full SHA for 7651821

  Browse repository at this point

• Fix wrong code path in docs. (#256)

  

  湛露先生

  authored
  762c761View commit details

  Copy full SHA for 762c761

  Browse repository at this point

• docs: update upcoming features

  eric-haibin-lin

  authored
  c46f403View commit details

  Copy full SHA for c46f403

  Browse repository at this point

Commits on Feb 11, 2025

• docs: add deepscaler

  eric-haibin-lin

  authored
  607b493View commit details

  Copy full SHA for 607b493

  Browse repository at this point

• fix: Typo in the rank zero code (#240)

  Show description for 95560d7
  ExtremeViscent

  authored
  95560d7View commit details

  Copy full SHA for 95560d7

  Browse repository at this point

Commits on Feb 10, 2025

• [misc] feat: give main_task num_cpus=1 (#244)

  Show description for bf9be15
  vermouth1992

  authored
  bf9be15View commit details

  Copy full SHA for bf9be15

  Browse repository at this point

• Feature/add remax support (#234)

  Show description for 769b8d0
  liziniu

  authored
  769b8d0View commit details

  Copy full SHA for 769b8d0

  Browse repository at this point

• Add stronger reward verification sandbox (#233)

  Show description for 5a66ed2
  ZefanW

  authored
  5a66ed2View commit details

  Copy full SHA for 5a66ed2

  Browse repository at this point

• fix: typo (#243)

  Show description for 16b1984
  

  湛露先生

  authored
  16b1984View commit details

  Copy full SHA for 16b1984

  Browse repository at this point

• clean unused package . (#239)

  Show description for 7e07349
  

  湛露先生

  authored
  7e07349View commit details

  Copy full SHA for 7e07349

  Browse repository at this point

Commits on Feb 9, 2025

• [misc]: fix ci and add warning to make sure wandb is used when logging val results (#237)

  Show description for 3d566ad
  PeterSH6

  authored
  3d566adView commit details

  Copy full SHA for 3d566ad

  Browse repository at this point

• delete redundant append_to_dict (#236)

  Show description for 6427f50
  Cppowboy

  authored
  6427f50View commit details

  Copy full SHA for 6427f50

  Browse repository at this point

• Add option to log validation generations to wandb (#177)

  Show description for d0725a6
  corbt

  authored
  d0725a6View commit details

  Copy full SHA for d0725a6

  Browse repository at this point

• [doc] fix document deprecated link (#235)

  Show description for 610c20c
  PeterSH6

  authored
  610c20cView commit details

  Copy full SHA for 610c20c

  Browse repository at this point

• add requirements (#231)

  Show description for 577a341
  ZefanW

  authored
  577a341View commit details

  Copy full SHA for 577a341

  Browse repository at this point

• docs: add programming model guide (#230)

  eric-haibin-lin

  authored
  e842b73View commit details

  Copy full SHA for e842b73

  Browse repository at this point

• implement REINFORCE++ algorithm (#228)

  Show description for bdb50ac
  4332001876

  authored
  bdb50acView commit details

  Copy full SHA for bdb50ac

  Browse repository at this point

Commits on Feb 8, 2025

• [ckpt] feat: integrate checkpoint resume in RL ray trainer (#222)

  Show description for 5a400bf
  PeterSH6

  authored
  5a400bfView commit details

  Copy full SHA for 5a400bf

  Browse repository at this point

• Fix typo tips in bash sft. (#226)

  Show description for 62a065b
  

  湛露先生

  authored
  62a065bView commit details

  Copy full SHA for 62a065b

  Browse repository at this point

• Memory efficiency improvement to logprobs_from_logits_v2 (#220)

  Show description for 4b51624
  tyler-romero

  authored
  4b51624View commit details

  Copy full SHA for 4b51624

  Browse repository at this point

Commits on Feb 7, 2025

• [TRACKING] feat: Integrate SwanLab for experiment tracking with online/offline mode and local dashboard support (#218)

  Show description for 958a326
  ShaohonChen

  authored
  958a326View commit details

  Copy full SHA for 958a326

  Browse repository at this point

• [rollout]: fix incorrect response_attention_mask in vLLM rollout (#213)

  Show description for 3140cc2
  kinman0224

  authored
  3140cc2View commit details

  Copy full SHA for 3140cc2

  Browse repository at this point

• [misc] feat: add ckpt manager in utils (#216)

  Show description for 27484a7
  PeterSH6

  authored
  27484a7View commit details

  Copy full SHA for 27484a7

  Browse repository at this point

Commits on Feb 6, 2025

• Create scorecard.yml for security scan (#215)

  Show description for ee23b7b
  willem-bd

  authored
  ee23b7bView commit details

  Copy full SHA for ee23b7b

  Browse repository at this point

• example: switch the default model ckpt for Megatron, add wandb logs (#210)

  Show description for ced8ecb
  

  eric-haibin-lin

  and

  Your Name

  authored
  ced8ecbView commit details

  Copy full SHA for ced8ecb

  Browse repository at this point

• docs: simple use name verl. add meetup info

  eric-haibin-lin

  authored
  22d56a8View commit details

  Copy full SHA for 22d56a8

  Browse repository at this point

Commits on Feb 5, 2025

• [misc] fix: load and offload in compute log prob (#208)

  Show description for 6872dbe
  PeterSH6

  authored
  6872dbeView commit details

  Copy full SHA for 6872dbe

  Browse repository at this point

• [CI] feat: make the digit completion ci use fsdp's ppo_config (#206)

  Show description for 89ba48e
  PeterSH6

  authored
  89ba48eView commit details

  Copy full SHA for 89ba48e

  Browse repository at this point

• [misc] refactor: refactor config, add grpo ci (#204)

  Show description for ac9d246
  vermouth1992

  authored
  ac9d246View commit details

  Copy full SHA for ac9d246

  Browse repository at this point

• Update README.md (#203)

  vermouth1992

  authored
  ce956ccView commit details

  Copy full SHA for ce956cc

  Browse repository at this point

• assert to make sure flash-attn>=2.4.3 (#202)

  Show description for 49913bd
  bebetterest

  authored
  49913bdView commit details

  Copy full SHA for 49913bd

  Browse repository at this point

• fix critic save error (#199)

  Show description for 4669ab9
  WeiXiongUST

  authored
  4669ab9View commit details

  Copy full SHA for 4669ab9

  Browse repository at this point

• docs: fixed link in gsm8k_example.rst (#200)

  Show description for ddfc04e
  

  jfncs

  and

  jaysonfrancis

  authored
  ddfc04eView commit details

  Copy full SHA for ddfc04e

  Browse repository at this point

Commits on Feb 4, 2025

• Call wandb.finish when the tracker is destructed if wandb is in use (#191)

  Show description for 483fa8a
  TonyLianLong

  authored
  483fa8aView commit details

  Copy full SHA for 483fa8a

  Browse repository at this point