Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Sep 13, 2024

• PEFT support for Online DPO (#2041)

  Show description for ebc85b2
  

  qgallouedec

  and

  lewtun

  authored
  ebc85b2View commit details

  Copy full SHA for ebc85b2

  Browse repository at this point

• Standardise API for `WinRateCallback` and `LogCompletionsCallback` (#2061)

  Show description for 88bede6
  lewtun

  authored
  88bede6View commit details

  Copy full SHA for 88bede6

  Browse repository at this point

• Shuffle examples before they are packed (#2037)

  Show description for 7a2bbe3
  

  muupan

  and

  lewtun

  authored
  7a2bbe3View commit details

  Copy full SHA for 7a2bbe3

  Browse repository at this point

• make cuda-only tests device-agnostic (#2044)

  Show description for d47220f
  

  faaany

  and

  lewtun

  authored
  d47220fView commit details

  Copy full SHA for d47220f

  Browse repository at this point

• Support for `SFTTrainer.evaluate()` and `SFTTrainer.predict()` with null train_dataset (#2004)

  Show description for d832492
  

  Sohaib9920

  and

  lewtun

  authored
  d832492View commit details

  Copy full SHA for d832492

  Browse repository at this point

• ©️ Copyrights (#2063)

  Show description for 4c92ba5
  qgallouedec

  authored
  4c92ba5View commit details

  Copy full SHA for 4c92ba5

  Browse repository at this point

• Mask loss in gkd when generating from the student (#2058)

  Show description for a5b98fc
  

  gaetanlop

  and

  kashif

  authored
  a5b98fcView commit details

  Copy full SHA for a5b98fc

  Browse repository at this point

Commits on Sep 11, 2024

• Add missing autodocs (#2056)

  qgallouedec

  authored
  e51a5acView commit details

  Copy full SHA for e51a5ac

  Browse repository at this point

• 📝 Document dataset format (#2020)

  Show description for 31b9387
  

  qgallouedec

  and

  lewtun

  authored
  31b9387View commit details

  Copy full SHA for 31b9387

  Browse repository at this point

• Gkd trainer (#1814)

  Show description for 85696aa
  

  3 peopleauthored
  85696aaView commit details

  Copy full SHA for 85696aa

  Browse repository at this point

• Remove `debug` and `sanity_check` args (#2055)

  qgallouedec

  authored
  642c4b1View commit details

  Copy full SHA for 642c4b1

  Browse repository at this point

• Clean up DPO example (#2043)

  Show description for 9a6061f
  lewtun

  authored
  9a6061fView commit details

  Copy full SHA for 9a6061f

  Browse repository at this point

• Remove `RichProgressCallback` from examples (#2053)

  Show description for a8fd6dc
  lewtun

  authored
  a8fd6dcView commit details

  Copy full SHA for a8fd6dc

  Browse repository at this point

• Integrate OrpoTrainer with PyTorchXLA for faster step time on TPUs (#2001)

  Show description for e2966c8
  

  3 peopleauthored
  e2966c8View commit details

  Copy full SHA for e2966c8

  Browse repository at this point

• Windows back in CI (#2051)

  Show description for 37934d7
  

  LysandreJik

  and

  qgallouedec

  authored
  37934d7View commit details

  Copy full SHA for 37934d7

  Browse repository at this point

• Fix logits compuation in KTO trainer prediction step (#2050)

  Show description for 9c043e5
  

  issamemari

  and

  kashif

  authored
  9c043e5View commit details

  Copy full SHA for 9c043e5

  Browse repository at this point

Commits on Sep 10, 2024

• Deprecate `PPOTrainer` (#2016)

  Show description for a20e822
  qgallouedec

  authored
  a20e822View commit details

  Copy full SHA for a20e822

  Browse repository at this point

• [XPO] xpo trainer (#1943)

  Show description for 3511856
  

  kashif

  and

  qgallouedec

  authored
  3511856View commit details

  Copy full SHA for 3511856

  Browse repository at this point

• Temporary pin the transformers hash in the CI (#2049)

  Show description for f8cf88a
  

  qgallouedec

  and

  kashif

  authored
  f8cf88aView commit details

  Copy full SHA for f8cf88a

  Browse repository at this point

• Change `non_eos_penalty` to `missing_eos_penalty ` to be consistent across `OnPolicy` trainers (#2033)

  Show description for 2ee0b62
  

  3 peopleauthored
  2ee0b62View commit details

  Copy full SHA for 2ee0b62

  Browse repository at this point

• Drop canonical dataset namespaces (#2048)

  Show description for ac071d6
  qgallouedec

  authored
  ac071d6View commit details

  Copy full SHA for ac071d6

  Browse repository at this point

Commits on Sep 9, 2024

• fix: unpackaging error in Custom Mixture of Experts model when `aux_loss_enabled` is set to True. (#2039)

  Show description for 72f19c3
  Jonathanjordan21

  authored
  72f19c3View commit details

  Copy full SHA for 72f19c3

  Browse repository at this point

• Fix `packing` doc in `SFTConfig` and fix error when neither `dataset_text_field` nor `formatting_func` is provided. (#2035)

  Show description for 8d7b54d
  

  qgallouedec

  and

  lewtun

  authored
  8d7b54dView commit details

  Copy full SHA for 8d7b54d

  Browse repository at this point

• Improves formatting of docstring + newlines (#2006)

  Show description for a638f73
  

  3 peopleauthored
  a638f73View commit details

  Copy full SHA for a638f73

  Browse repository at this point

Commits on Sep 8, 2024

• Remove unused functions (#2017)

  northern-64bit

  authored
  8a518eeView commit details

  Copy full SHA for 8a518ee

  Browse repository at this point

• Fix docs formatting of ˋ\timesˋ sign in ˋkto_trainer.mdxˋ (#2031)

  Show description for 7a67de3
  mattany

  authored
  7a67de3View commit details

  Copy full SHA for 7a67de3

  Browse repository at this point

Commits on Sep 6, 2024

• Refactor reward modelling script to work with chat models (#2026)

  Show description for 3412f51
  lewtun

  authored
  3412f51View commit details

  Copy full SHA for 3412f51

  Browse repository at this point

Commits on Sep 4, 2024

• Clean configs documentation (#1944)

  Show description for fc20db8
  qgallouedec

  authored
  fc20db8View commit details

  Copy full SHA for fc20db8

  Browse repository at this point

• Feat: Add support for APO-zero in KTOTrainer (#1952)

  Show description for 7acb9c2
  

  4 peopleauthored
  7acb9c2View commit details

  Copy full SHA for 7acb9c2

  Browse repository at this point

Commits on Sep 3, 2024

• Allow `WinRateCallback` to be used without reference model (#2013)

  Show description for 6840380
  qgallouedec

  authored
  6840380View commit details

  Copy full SHA for 6840380

  Browse repository at this point

• Remove `prompts` arg from `WinrateCallback` (#2010)

  Show description for 1f6a1d2
  qgallouedec

  authored
  1f6a1d2View commit details

  Copy full SHA for 1f6a1d2

  Browse repository at this point

• [ci] pin numpy to < 2 on win (#2009)

  kashif

  authored
  d60a1f5View commit details

  Copy full SHA for d60a1f5

  Browse repository at this point

• [Docs] Add Liger-Kernel usage to SFTTrainer page (#2007)

  Show description for 728a9a3
  

  ryankert01

  and

  ByronHsu

  authored
  728a9a3View commit details

  Copy full SHA for 728a9a3

  Browse repository at this point

Commits on Sep 2, 2024

• [pre-commit] update pre-commit yaml (#2002)

  Show description for 850ddcf
  kashif

  authored
  850ddcfView commit details

  Copy full SHA for 850ddcf

  Browse repository at this point

Commits on Aug 30, 2024

• [Online-DPO] fixes to the training scripts and setup.py (#1997)

  Show description for d57e4b7
  kashif

  authored
  d57e4b7View commit details

  Copy full SHA for d57e4b7

  Browse repository at this point