Commits

Branch selector

main

User selector

lewtun

Datepicker

All time

Commit history

Commits on Jan 31, 2025

• Improve GRPO example (#2717)

  lewtun

  authored
  bf69191View commit details

  Copy full SHA for bf69191

  Browse repository at this point

Commits on Nov 29, 2024

• Add note about special tokens in chat templates for LoRA SFT (#2414)

  lewtun

  authored
  2c6e0d9View commit details

  Copy full SHA for 2c6e0d9

  Browse repository at this point

Commits on Nov 19, 2024

• Fix dev install (#2369)

  lewtun

  authored
  066fc37View commit details

  Copy full SHA for 066fc37

  Browse repository at this point

Commits on Oct 17, 2024

• Update SFT examples (#2244)

  lewtun

  authored
  a67f214View commit details

  Copy full SHA for a67f214

  Browse repository at this point

Commits on Sep 30, 2024

• [GKD] Set custom EOS tokens in generation config (#2142)

  Show description for de38765
  

  lewtun

  and

  qgallouedec

  authored
  de38765View commit details

  Copy full SHA for de38765

  Browse repository at this point

Commits on Sep 27, 2024

• Add correct label for `WinRateCallback` table (#2134)

  Show description for 124189c
  lewtun

  authored
  124189cView commit details

  Copy full SHA for 124189c

  Browse repository at this point

Commits on Sep 26, 2024

• Add table for WinRateCallback (#2116)

  Show description for b169e10
  

  lewtun

  and

  qgallouedec

  authored
  b169e10View commit details

  Copy full SHA for b169e10

  Browse repository at this point

Commits on Sep 24, 2024

• [`RewardTrainer`] Tokenize inputs within trainer (#2102)

  Show description for cc23b51
  

  lewtun

  and

  qgallouedec

  authored
  cc23b51View commit details

  Copy full SHA for cc23b51

  Browse repository at this point

Commits on Sep 23, 2024

• Fix PPO/RLOO examples (#2100)

  lewtun

  authored
  6859e04View commit details

  Copy full SHA for 6859e04

  Browse repository at this point

• Clean up README and remove openrlbenchmark dependency (#2085)

  Show description for 92eea1f
  

  lewtun

  and

  qgallouedec

  authored
  92eea1fView commit details

  Copy full SHA for 92eea1f

  Browse repository at this point

Commits on Sep 19, 2024

• Bump dev version

  lewtun

  committed
  3cec013View commit details

  Copy full SHA for 3cec013

  Browse repository at this point

Commits on Sep 18, 2024

• Use wrapped model for reference completions in `WinRateCallback` and set default `freq` to `eval_steps` in LogCompletionsCallback` (#2074)

  Show description for 4d82676
  

  lewtun

  and

  qgallouedec

  authored
  4d82676View commit details

  Copy full SHA for 4d82676

  Browse repository at this point

Commits on Sep 14, 2024

• Fix dataset in GKD script (#2067)

  Show description for 08ba866
  lewtun

  authored
  08ba866View commit details

  Copy full SHA for 08ba866

  Browse repository at this point

Commits on Sep 13, 2024

• Standardise API for `WinRateCallback` and `LogCompletionsCallback` (#2061)

  Show description for 88bede6
  lewtun

  authored
  88bede6View commit details

  Copy full SHA for 88bede6

  Browse repository at this point

Commits on Sep 11, 2024

• Clean up DPO example (#2043)

  Show description for 9a6061f
  lewtun

  authored
  9a6061fView commit details

  Copy full SHA for 9a6061f

  Browse repository at this point

• Remove `RichProgressCallback` from examples (#2053)

  Show description for a8fd6dc
  lewtun

  authored
  a8fd6dcView commit details

  Copy full SHA for a8fd6dc

  Browse repository at this point

Commits on Sep 6, 2024

• Refactor reward modelling script to work with chat models (#2026)

  Show description for 3412f51
  lewtun

  authored
  3412f51View commit details

  Copy full SHA for 3412f51

  Browse repository at this point

Commits on Aug 29, 2024

• Bump dev version

  lewtun

  committed
  437e8ccView commit details

  Copy full SHA for 437e8cc

  Browse repository at this point

Commits on Aug 27, 2024

• Restore test (#1982)

  lewtun

  authored
  0cda2f2View commit details

  Copy full SHA for 0cda2f2

  Browse repository at this point

• Fix flaky Hub tests (#1981)

  Show description for b65657f
  lewtun

  authored
  b65657fView commit details

  Copy full SHA for b65657f

  Browse repository at this point

Commits on Aug 23, 2024

• Add issue/PR templates, code of conduct & better contributing guide (#1963)

  Show description for dcee683
  

  lewtun

  and

  qgallouedec

  authored
  dcee683View commit details

  Copy full SHA for dcee683

  Browse repository at this point

Commits on Aug 22, 2024

• [ODPO] Refactor training script to use messages API (#1958)

  Show description for 6cea2ef
  lewtun

  authored
  6cea2efView commit details

  Copy full SHA for 6cea2ef

  Browse repository at this point

Commits on Aug 21, 2024

• Fix global step for consistent checkpointing with global updates (#1950)

  lewtun

  authored
  e529579View commit details

  Copy full SHA for e529579

  Browse repository at this point

Commits on Aug 20, 2024

• Log WandB tables on main process (#1951)

  lewtun

  authored
  dc4cfabView commit details

  Copy full SHA for dc4cfab

  Browse repository at this point

Commits on Aug 19, 2024

• Fix model wrapping for online DPO (#1946)

  lewtun

  authored
  616a273View commit details

  Copy full SHA for 616a273

  Browse repository at this point

Commits on Aug 13, 2024

• Add explicit library name for TRL repos (#1922)

  lewtun

  authored
  a9a7565View commit details

  Copy full SHA for a9a7565

  Browse repository at this point

Commits on Jul 18, 2024

• Add `WinRateCallback` and Judges (#1598)

  Show description for 4dce042
  

  lewtun

  and

  qgallouedec

  authored
  4dce042View commit details

  Copy full SHA for 4dce042

  Browse repository at this point

Commits on May 3, 2024

• Fix ZeRO-3 generation context manager (#1617)

  lewtun

  authored
  0347f58View commit details

  Copy full SHA for 0347f58

  Browse repository at this point

Commits on May 2, 2024

• Use auto device map (#1596)

  lewtun

  authored
  5f09131View commit details

  Copy full SHA for 5f09131

  Browse repository at this point

Commits on Apr 8, 2024

• Speed up PPO with ZeRO-3 by 10x 🔥 (#1483)

  Show description for f35b68a
  lewtun

  authored
  f35b68aView commit details

  Copy full SHA for f35b68a

  Browse repository at this point

Commits on Mar 27, 2024

• Update KTO example to use better model and ChatML support (#1485)

  Show description for 0ee349d
  lewtun

  authored
  0ee349dView commit details

  Copy full SHA for 0ee349d

  Browse repository at this point

• Ignore chat files (#1486)

  Show description for 7ff6206
  

  lewtun

  and

  lvwerra

  authored
  7ff6206View commit details

  Copy full SHA for 7ff6206

  Browse repository at this point

Commits on Mar 26, 2024

• [KTO] Use batching to speed up data processing (#1470)

  Show description for 6c2f829
  lewtun

  authored
  6c2f829View commit details

  Copy full SHA for 6c2f829

  Browse repository at this point

Commits on Mar 25, 2024

• Update KTO example with good dataset & chat format (#1481)

  Show description for c4f0f41
  lewtun

  authored
  c4f0f41View commit details

  Copy full SHA for c4f0f41

  Browse repository at this point

Commits on Mar 24, 2024

• Fix hyperparameters in KTO example (#1474)

  Show description for 9ce7ac6
  lewtun

  authored
  9ce7ac6View commit details

  Copy full SHA for 9ce7ac6

  Browse repository at this point