Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jan 31, 2025

• 🏰 `num_logits_to_keep` to `logits_to_keep` (#2721)

  qgallouedec

  authored
  1c35a48View commit details

  Copy full SHA for 1c35a48

  Browse repository at this point

• 📖 Nit fix in SFT Documentation (#2722)

  ParagEkbote

  authored
  2ce36aeView commit details

  Copy full SHA for 2ce36ae

  Browse repository at this point

• Improve GRPO example (#2717)

  lewtun

  authored
  bf69191View commit details

  Copy full SHA for bf69191

  Browse repository at this point

• 📖 Add GRPOTrainer to README.md (#2713)

  Show description for 265663a
  

  burtenshaw

  and

  qgallouedec

  authored
  265663aView commit details

  Copy full SHA for 265663a

  Browse repository at this point

• fix: Fix typo in filename Update ultrafeedback.py (#2699)

  brawncode

  authored
  5ab15d3View commit details

  Copy full SHA for 5ab15d3

  Browse repository at this point

Commits on Jan 30, 2025

• 📋 Add eval loss logging during prediction in GRPO (#2694)

  Show description for fecaa99
  

  kashif

  and

  qgallouedec

  authored
  fecaa99View commit details

  Copy full SHA for fecaa99

  Browse repository at this point

• 💡 Add "Mini-R1: Reproduce Deepseek R1 „aha moment“ a RL tutorial" (#2697)

  Show description for ab30a01
  qgallouedec

  authored
  ab30a01View commit details

  Copy full SHA for ab30a01

  Browse repository at this point

• ☠️ Remove deprecated (#2692)

  Show description for 6dc278a
  qgallouedec

  authored
  6dc278aView commit details

  Copy full SHA for 6dc278a

  Browse repository at this point

• 🧠 Fix typo in "understand" in ppo_trainer.md (#2695)

  famouswizard

  authored
  67441bbView commit details

  Copy full SHA for 67441bb

  Browse repository at this point

• docs: Fix broken "Good First Issue" link in CONTRIBUTING.md (#2693)

  Show description for 62685fb
  

  famouswizard

  and

  kashif

  authored
  62685fbView commit details

  Copy full SHA for 62685fb

  Browse repository at this point

• 🙈 Fixed typo in the GRPO documentation (#2691)

  famouswizard

  authored
  4197956View commit details

  Copy full SHA for 4197956

  Browse repository at this point

• 📄 Add GRPO batch size note in docs (#2672)

  Show description for 9ac8d97
  

  sdpkjc

  and

  qgallouedec

  authored
  9ac8d97View commit details

  Copy full SHA for 9ac8d97

  Browse repository at this point

• 📖 Docs fix spelling issues (#2682)

  Show description for 094d51b
  nnsW3

  authored
  094d51bView commit details

  Copy full SHA for 094d51b

  Browse repository at this point

• 📦 `trl.templates` in excluded packages (#2690)

  qgallouedec

  authored
  df8f619View commit details

  Copy full SHA for df8f619

  Browse repository at this point

• ⬆️ Bump dev version (#2689)

  qgallouedec

  authored
  56880baView commit details

  Copy full SHA for 56880ba

  Browse repository at this point

Commits on Jan 29, 2025

• 📉 Use `num_logits_to_keep` to reduce memory usage in GRPO (#2683)

  Show description for 801582e
  qgallouedec

  authored
  801582eView commit details

  Copy full SHA for 801582e

  Browse repository at this point

• ⚡ vLLM for fast generation in GRPO (#2600)

  Show description for ed14ed9
  

  3 peopleauthored
  ed14ed9View commit details

  Copy full SHA for ed14ed9

  Browse repository at this point

Commits on Jan 28, 2025

• 🖊 Fix typos (#2673)

  Show description for 4659ad9
  omahs

  authored
  4659ad9View commit details

  Copy full SHA for 4659ad9

  Browse repository at this point

Commits on Jan 26, 2025

• 🏷️ Add model tags to model trained with GRPO (#2663)

  qgallouedec

  authored
  1123bd0View commit details

  Copy full SHA for 1123bd0

  Browse repository at this point

• 🌀 Fix GRPO default completion length doc (#2662)

  andyl98

  authored
  55a329eView commit details

  Copy full SHA for 55a329e

  Browse repository at this point

Commits on Jan 25, 2025

• 📏 Log completion length in GRPO (#2659)

  qgallouedec

  authored
  4720656View commit details

  Copy full SHA for 4720656

  Browse repository at this point

• 📍 Disable caching when grad checkpointing enable in GRPO (#2653)

  Show description for 807046b
  qgallouedec

  authored
  807046bView commit details

  Copy full SHA for 807046b

  Browse repository at this point

• 🔎 Finegrained reward logging for GRPO (#2651)

  qgallouedec

  authored
  317d2d4View commit details

  Copy full SHA for 317d2d4

  Browse repository at this point

• 👐 DeepSpeed integration for GRPO (#2652)

  qgallouedec

  authored
  aeb03cfView commit details

  Copy full SHA for aeb03cf

  Browse repository at this point

Commits on Jan 24, 2025

• 🚛 Provide all columns of the dataset to the reward function (#2650)

  Show description for 2578e95
  qgallouedec

  authored
  2578e95View commit details

  Copy full SHA for 2578e95

  Browse repository at this point

• 🥞 Fix KTO gradient accumulation loss scaling (#2648)

  qgallouedec

  authored
  6f99f42View commit details

  Copy full SHA for 6f99f42

  Browse repository at this point

• 🥞 Fix GRPO gradient accumulation loss scaling (#2647)

  qgallouedec

  authored
  d14f7f3View commit details

  Copy full SHA for d14f7f3

  Browse repository at this point

• 🥞 Fix CPO gradient accumulation loss scaling (#2645)

  qgallouedec

  authored
  8e65825View commit details

  Copy full SHA for 8e65825

  Browse repository at this point

• Update grpo_trainer.md

  qgallouedec

  authored
  5e4d7beView commit details

  Copy full SHA for 5e4d7be

  Browse repository at this point

Commits on Jan 23, 2025

• 🌯 Fix context manager runtime error when gather is disabled (#2639)

  Superskyyy

  authored
  f34b70aView commit details

  Copy full SHA for f34b70a

  Browse repository at this point

• 🍭 Custom reward function for RLOO (#2612)

  Show description for 0e216f7
  August-murr

  authored
  0e216f7View commit details

  Copy full SHA for 0e216f7

  Browse repository at this point

• 🥞 Fix BCO gradient accumulation loss scaling (#2638)

  qgallouedec

  authored
  59c2014View commit details

  Copy full SHA for 59c2014

  Browse repository at this point

• 🥞 Fix DPO gradient accumulation loss scaling (#2615)

  Show description for 40c2383
  

  winglian

  and

  qgallouedec

  authored
  40c2383View commit details

  Copy full SHA for 40c2383

  Browse repository at this point

• 🏆 Custom reward function for GRPO and shiny doc (#2606)

  Show description for a1d2955
  

  qgallouedec

  and

  lewtun

  authored
  a1d2955View commit details

  Copy full SHA for a1d2955

  Browse repository at this point

• 💎 Rename an inner var in GRPO to improve clarity (#2616)

  Show description for 887c1f3
  qgallouedec

  authored
  887c1f3View commit details

  Copy full SHA for 887c1f3

  Browse repository at this point