Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jul 18, 2024

• Online DPO and Online trainer refactor (#1809)

  Show description for 4e85bd7
  

  3 peopleauthored
  4e85bd7View commit details

  Copy full SHA for 4e85bd7

  Browse repository at this point

• rm token (#1852)

  qgallouedec

  authored
  c9d5636View commit details

  Copy full SHA for c9d5636

  Browse repository at this point

• Add `WinRateCallback` and Judges (#1598)

  Show description for 4dce042
  

  lewtun

  and

  qgallouedec

  authored
  4dce042View commit details

  Copy full SHA for 4dce042

  Browse repository at this point

Commits on Jul 17, 2024

• dpo vlm blog post (#1844)

  Show description for 98ad01d
  qgallouedec

  authored
  98ad01dView commit details

  Copy full SHA for 98ad01d

  Browse repository at this point

• fix arg parsing in chat.py (#1846)

  Show description for fef8240
  

  lvwerra

  and

  leandro

  authored
  fef8240View commit details

  Copy full SHA for fef8240

  Browse repository at this point

• add link to DPO datasets collection (#1845)

  davanstrien

  authored
  915ffc7View commit details

  Copy full SHA for 915ffc7

  Browse repository at this point

• Fix issues of KTOTrainer (#1840)

  Show description for 5828a66
  

  MAOJIASONG

  and

  kashif

  authored
  5828a66View commit details

  Copy full SHA for 5828a66

  Browse repository at this point

Commits on Jul 16, 2024

• fix ppov2_trainer tensorboard log bugs (#1836)

  DZ9

  authored
  052a8e1View commit details

  Copy full SHA for 052a8e1

  Browse repository at this point

Commits on Jul 15, 2024

• `ref_model` -> `model_ref` (#1835)

  Show description for a2adfb8
  qgallouedec

  authored
  a2adfb8View commit details

  Copy full SHA for a2adfb8

  Browse repository at this point

• refactor trainer callbacks (#1826)

  Show description for 4ebfc5d
  kashif

  authored
  4ebfc5dView commit details

  Copy full SHA for 4ebfc5d

  Browse repository at this point

Commits on Jul 10, 2024

• Added missing token kwarg in Peft model loading (#1825)

  mkopecki

  authored
  9e9dc96View commit details

  Copy full SHA for 9e9dc96

  Browse repository at this point

• Make use of `trust_remote_code` consistent (#1806)

  Show description for 7ddef5c
  qgallouedec

  authored
  7ddef5cView commit details

  Copy full SHA for 7ddef5c

  Browse repository at this point

• Delete unused benchmark.yml workflow. (#1822)

  AdnaneKhan

  authored
  a9cddf8View commit details

  Copy full SHA for a9cddf8

  Browse repository at this point

Commits on Jul 9, 2024

• DPO Llava 1.5 and PaliGemma support (#1797)

  Show description for 2860ce5
  qgallouedec

  authored
  2860ce5View commit details

  Copy full SHA for 2860ce5

  Browse repository at this point

• upgrade gh actions (#1818)

  Show description for 30e33bd
  qgallouedec

  authored
  30e33bdView commit details

  Copy full SHA for 30e33bd

  Browse repository at this point

Commits on Jul 8, 2024

• Set dev version (#1817)

  vwxyzjn

  authored
  d5a0d2dView commit details

  Copy full SHA for d5a0d2d

  Browse repository at this point

• fix broken url in `docs\source\index.mdx` (#1813)

  psb-cc

  authored
  314e8ebView commit details

  Copy full SHA for 314e8eb

  Browse repository at this point

• 0.9.6 release (#1816)

  vwxyzjn

  authored
  e107920View commit details

  Copy full SHA for e107920

  Browse repository at this point

Commits on Jul 7, 2024

• Fix `TRL_USE_RICH` environment variable handling (#1808)

  Show description for 78045de
  alvarobartt

  authored
  78045deView commit details

  Copy full SHA for 78045de

  Browse repository at this point

Commits on Jul 5, 2024

• Fix `torch_dtype` handling in `{DPO,SFT}Trainer` when provided via CLI (#1807)

  Show description for 747612f
  

  alvarobartt

  and

  yash-srivastava19

  authored
  747612fView commit details

  Copy full SHA for 747612f

  Browse repository at this point

• Remove extra print in reward_trainer.py (#1799)

  Show description for 9e3a35b
  mnoukhov

  authored
  9e3a35bView commit details

  Copy full SHA for 9e3a35b

  Browse repository at this point

Commits on Jul 4, 2024

• clean examples (#1791)

  Show description for 4402b36
  qgallouedec

  authored
  4402b36View commit details

  Copy full SHA for 4402b36

  Browse repository at this point

Commits on Jul 3, 2024

• Bugfix: Preserve token fields when converting TrainingArguments to SFTConfig (#1794)

  Show description for 78f8228
  noahlt

  authored
  78f8228View commit details

  Copy full SHA for 78f8228

  Browse repository at this point

• add model_init_kwargs to training_args (#1787)

  kashif

  authored
  b6af2edView commit details

  Copy full SHA for b6af2ed

  Browse repository at this point

Commits on Jun 29, 2024

• Fixed typo in SFT trainer docs (#1788)

  Show description for cd85b14
  detsutut

  authored
  cd85b14View commit details

  Copy full SHA for cd85b14

  Browse repository at this point

Commits on Jun 27, 2024

• fix docs and examples (#1780)

  kashif

  authored
  a57544fView commit details

  Copy full SHA for a57544f

  Browse repository at this point

Commits on Jun 26, 2024

• Visual DPO (#1647)

  Show description for b68ff96
  

  qgallouedec

  and

  kashif

  authored
  b68ff96View commit details

  Copy full SHA for b68ff96

  Browse repository at this point

• Fix Documentation Overflow Issues for Long URLs in SFTConfig (#1774)

  Show description for c8c01cc
  Mubin17

  authored
  c8c01ccView commit details

  Copy full SHA for c8c01cc

  Browse repository at this point

• Remove the leading space in the tldr preference dataset (#1773)

  vwxyzjn

  authored
  3479606View commit details

  Copy full SHA for 3479606

  Browse repository at this point

Commits on Jun 25, 2024

• add Efficient Exact Optimization (EXO) (#1735)

  Show description for 7965b78
  

  haozheji

  and

  kashif

  authored
  7965b78View commit details

  Copy full SHA for 7965b78

  Browse repository at this point

• `evaluation_strategy` to `eval_strategy` (#1771)

  Show description for 56bd1bb
  qgallouedec

  authored
  56bd1bbView commit details

  Copy full SHA for 56bd1bb

  Browse repository at this point

Commits on Jun 24, 2024

• MoE Models: option to add load balancing loss (#1765)

  Show description for 94d53e6
  

  claralp

  and

  Clara Luise Pohland

  authored
  94d53e6View commit details

  Copy full SHA for 94d53e6

  Browse repository at this point

• Added Reward Backpropogation Support (#1585)

  Show description for b5be100
  

  mihirp1998

  and

  younesbelkada

  authored
  b5be100View commit details

  Copy full SHA for b5be100

  Browse repository at this point

Commits on Jun 23, 2024

• Add CPO-SimPO method (#1760)

  Show description for 6e1652b
  

  fe1ixxu

  and

  kashif

  authored
  6e1652bView commit details

  Copy full SHA for 6e1652b

  Browse repository at this point

Commits on Jun 21, 2024

• New sentiment and descriptiveness dataset (#1757)

  Show description for 65374c6
  vwxyzjn

  authored
  65374c6View commit details

  Copy full SHA for 65374c6

  Browse repository at this point