Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Feb 4, 2025

• 🚧 Add Optional ZeRO-3 Weight Gathering for GRPO in Sequence Generation (#2667)

  Show description for af4ad47
  

  SeungyounShin

  and

  qgallouedec

  authored
  af4ad47View commit details

  Copy full SHA for af4ad47

  Browse repository at this point

• 🔁 🦈 Support iterative GRPO (#2700)

  Show description for b2ae999
  

  shirinyamani

  and

  qgallouedec

  authored
  b2ae999View commit details

  Copy full SHA for b2ae999

  Browse repository at this point

• 🤖 Properly unwrap torch.compile-ed models in GRPO (#2750)

  Show description for bd946f9
  

  winglian

  and

  qgallouedec

  authored
  bd946f9View commit details

  Copy full SHA for bd946f9

  Browse repository at this point

• 🔎 Add missing script argument in PPO documentation (#2720)

  JohnConnor123

  authored
  f42e34eView commit details

  Copy full SHA for f42e34e

  Browse repository at this point

• 📖 Clarification max len in Reward documentation (#2740)

  Show description for 338fbd5
  

  ParagEkbote

  and

  qgallouedec

  authored
  338fbd5View commit details

  Copy full SHA for 338fbd5

  Browse repository at this point

• 📐 Add vLLM dtype configuration for GRPO trainer (#2738)

  Show description for 32f8fa8
  

  joey00072

  and

  qgallouedec

  authored
  32f8fa8View commit details

  Copy full SHA for 32f8fa8

  Browse repository at this point

• 📌 vLLM >= 0.7.1 for device fix (#2766)

  Show description for 1a22764
  ctjlewis

  authored
  1a22764View commit details

  Copy full SHA for 1a22764

  Browse repository at this point

• 💔 Decouple loss computing and generation in GRPO (#2762)

  qgallouedec

  authored
  1f344c9View commit details

  Copy full SHA for 1f344c9

  Browse repository at this point

• 🔂 Use vLLM prefix caching for speedup (#2757)

  Show description for 85121fc
  

  winglian

  and

  qgallouedec

  authored
  85121fcView commit details

  Copy full SHA for 85121fc

  Browse repository at this point

Commits on Feb 2, 2025

• ⚠️ Fix attention masking in GRPO (#2708)

  Show description for bbdd6db
  

  3 peopleauthored
  bbdd6dbView commit details

  Copy full SHA for bbdd6db

  Browse repository at this point

• docs: Fix typos in alias descriptions (#2729)

  defiberrys

  authored
  6e088d1View commit details

  Copy full SHA for 6e088d1

  Browse repository at this point

Commits on Feb 1, 2025

• fix: Fix typo in filename in ultrafeedback-prompt.py (#2716)

  brawncode

  authored
  a325a0eView commit details

  Copy full SHA for a325a0e

  Browse repository at this point

• 💰 Fix incorrect calculation in Olivia's baguette spending logic (#2727)

  defiberrys

  authored
  0ec1ccdView commit details

  Copy full SHA for 0ec1ccd

  Browse repository at this point

Commits on Jan 31, 2025

• 🏰 `num_logits_to_keep` to `logits_to_keep` (#2721)

  qgallouedec

  authored
  1c35a48View commit details

  Copy full SHA for 1c35a48

  Browse repository at this point

• 📖 Nit fix in SFT Documentation (#2722)

  ParagEkbote

  authored
  2ce36aeView commit details

  Copy full SHA for 2ce36ae

  Browse repository at this point

• Improve GRPO example (#2717)

  lewtun

  authored
  bf69191View commit details

  Copy full SHA for bf69191

  Browse repository at this point

• 📖 Add GRPOTrainer to README.md (#2713)

  Show description for 265663a
  

  burtenshaw

  and

  qgallouedec

  authored
  265663aView commit details

  Copy full SHA for 265663a

  Browse repository at this point

• fix: Fix typo in filename Update ultrafeedback.py (#2699)

  brawncode

  authored
  5ab15d3View commit details

  Copy full SHA for 5ab15d3

  Browse repository at this point

Commits on Jan 30, 2025

• 📋 Add eval loss logging during prediction in GRPO (#2694)

  Show description for fecaa99
  

  kashif

  and

  qgallouedec

  authored
  fecaa99View commit details

  Copy full SHA for fecaa99

  Browse repository at this point

• 💡 Add "Mini-R1: Reproduce Deepseek R1 „aha moment“ a RL tutorial" (#2697)

  Show description for ab30a01
  qgallouedec

  authored
  ab30a01View commit details

  Copy full SHA for ab30a01

  Browse repository at this point

• ☠️ Remove deprecated (#2692)

  Show description for 6dc278a
  qgallouedec

  authored
  6dc278aView commit details

  Copy full SHA for 6dc278a

  Browse repository at this point

• 🧠 Fix typo in "understand" in ppo_trainer.md (#2695)

  famouswizard

  authored
  67441bbView commit details

  Copy full SHA for 67441bb

  Browse repository at this point

• docs: Fix broken "Good First Issue" link in CONTRIBUTING.md (#2693)

  Show description for 62685fb
  

  famouswizard

  and

  kashif

  authored
  62685fbView commit details

  Copy full SHA for 62685fb

  Browse repository at this point

• 🙈 Fixed typo in the GRPO documentation (#2691)

  famouswizard

  authored
  4197956View commit details

  Copy full SHA for 4197956

  Browse repository at this point

• 📄 Add GRPO batch size note in docs (#2672)

  Show description for 9ac8d97
  

  sdpkjc

  and

  qgallouedec

  authored
  9ac8d97View commit details

  Copy full SHA for 9ac8d97

  Browse repository at this point

• 📖 Docs fix spelling issues (#2682)

  Show description for 094d51b
  nnsW3

  authored
  094d51bView commit details

  Copy full SHA for 094d51b

  Browse repository at this point

• 📦 `trl.templates` in excluded packages (#2690)

  qgallouedec

  authored
  df8f619View commit details

  Copy full SHA for df8f619

  Browse repository at this point

• ⬆️ Bump dev version (#2689)

  qgallouedec

  authored
  56880baView commit details

  Copy full SHA for 56880ba

  Browse repository at this point

Commits on Jan 29, 2025

• 📉 Use `num_logits_to_keep` to reduce memory usage in GRPO (#2683)

  Show description for 801582e
  qgallouedec

  authored
  801582eView commit details

  Copy full SHA for 801582e

  Browse repository at this point

• ⚡ vLLM for fast generation in GRPO (#2600)

  Show description for ed14ed9
  

  3 peopleauthored
  ed14ed9View commit details

  Copy full SHA for ed14ed9

  Browse repository at this point

Commits on Jan 28, 2025

• 🖊 Fix typos (#2673)

  Show description for 4659ad9
  omahs

  authored
  4659ad9View commit details

  Copy full SHA for 4659ad9

  Browse repository at this point

Commits on Jan 26, 2025

• 🏷️ Add model tags to model trained with GRPO (#2663)

  qgallouedec

  authored
  1123bd0View commit details

  Copy full SHA for 1123bd0

  Browse repository at this point

• 🌀 Fix GRPO default completion length doc (#2662)

  andyl98

  authored
  55a329eView commit details

  Copy full SHA for 55a329e

  Browse repository at this point

Commits on Jan 25, 2025

• 📏 Log completion length in GRPO (#2659)

  qgallouedec

  authored
  4720656View commit details

  Copy full SHA for 4720656

  Browse repository at this point

• 📍 Disable caching when grad checkpointing enable in GRPO (#2653)

  Show description for 807046b
  qgallouedec

  authored
  807046bView commit details

  Copy full SHA for 807046b

  Browse repository at this point