Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Sep 26, 2024

• Tokenize row during in `training_step` in `OnlineDPOTrainer` (#2117)

  Show description for a0d7149
  

  qgallouedec

  and

  lewtun

  authored
  a0d7149View commit details

  Copy full SHA for a0d7149

  View code at this pointBrowse repository at this point

• Standardize pushing to Hub in examples (#2126)

  qgallouedec

  authored
  32d9d34View commit details

  Copy full SHA for 32d9d34

  View code at this pointBrowse repository at this point

• Remove `max_length` from `RewardDataCollatorWithPadding` (#2119)

  qgallouedec

  authored
  fb1b48fView commit details

  Copy full SHA for fb1b48f

  View code at this pointBrowse repository at this point

Commits on Sep 24, 2024

• `BCOTrainer` conversational dataset support (#2107)

  Show description for 44a06fc
  

  qgallouedec

  and

  lewtun

  authored
  44a06fcView commit details

  Copy full SHA for 44a06fc

  View code at this pointBrowse repository at this point

• [online-dpo] allow parse-args as list of floats (#2108)

  Show description for 80038a5
  

  kashif

  and

  qgallouedec

  authored
  80038a5View commit details

  Copy full SHA for 80038a5

  View code at this pointBrowse repository at this point

• [`RewardTrainer`] Tokenize inputs within trainer (#2102)

  Show description for cc23b51
  

  lewtun

  and

  qgallouedec

  authored
  cc23b51View commit details

  Copy full SHA for cc23b51

  View code at this pointBrowse repository at this point

• [CLI] `trl env` for printing system info (#2104)

  qgallouedec

  authored
  2cad48dView commit details

  Copy full SHA for 2cad48d

  View code at this pointBrowse repository at this point

Commits on Sep 21, 2024

• KTO: fix logits metric, add logits metric to BCOTrainer too (#2094)

  Show description for 663002f
  

  claralp

  and

  Clara Luise Pohland

  authored
  663002fView commit details

  Copy full SHA for 663002f

  View code at this pointBrowse repository at this point

• Fix _process_tokens for empty prompts in KTOTrainer (#2093)

  Show description for 44d998b
  gabikadlecova

  authored
  44d998bView commit details

  Copy full SHA for 44d998b

  View code at this pointBrowse repository at this point

• fix: device could be in meta, transformers#33154 (#2089)

  Show description for 9b80f3d
  fabianlim

  authored
  9b80f3dView commit details

  Copy full SHA for 9b80f3d

  View code at this pointBrowse repository at this point

Commits on Sep 19, 2024

• [SFT] fix neftune_noise_alpha in SFTTrainer (#1841)

  Show description for 9fb871f
  

  3 peopleauthored
  9fb871fView commit details

  Copy full SHA for 9fb871f

  View code at this pointBrowse repository at this point

• Bump dev version

  lewtun

  committed
  3cec013View commit details

  Copy full SHA for 3cec013

  View code at this pointBrowse repository at this point

• Fix DeepSpeed for `PPOv2Trainer.save` (#2080)

  qgallouedec

  authored
  cc80ac6View commit details

  Copy full SHA for cc80ac6

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2024

• [WIP] Fix `logits/chosen` and `logits/rejected` metrics in `KTOTrainer` (#2077)

  Show description for 0d2bee5
  PhilipMay

  authored
  0d2bee5View commit details

  Copy full SHA for 0d2bee5

  View code at this pointBrowse repository at this point

• Conversational dataset support for Online DPO (#2075)

  Show description for 6920c2d
  qgallouedec

  authored
  6920c2dView commit details

  Copy full SHA for 6920c2d

  View code at this pointBrowse repository at this point

• Use wrapped model for reference completions in `WinRateCallback` and set default `freq` to `eval_steps` in LogCompletionsCallback` (#2074)

  Show description for 4d82676
  

  lewtun

  and

  qgallouedec

  authored
  4d82676View commit details

  Copy full SHA for 4d82676

  View code at this pointBrowse repository at this point

Commits on Sep 17, 2024

• `processor(prompt, images=image)` to `processor(images=image, text=prompt)` (#2076)

  Show description for c314383
  qgallouedec

  authored
  c314383View commit details

  Copy full SHA for c314383

  View code at this pointBrowse repository at this point

• Added error when `ref_model` and `model` have same id (#2057)

  Show description for e74dbf2
  

  3 peopleauthored
  e74dbf2View commit details

  Copy full SHA for e74dbf2

  View code at this pointBrowse repository at this point

Commits on Sep 16, 2024

• Minor doc fixes and comments (#2073)

  Show description for 41fe228
  qgallouedec

  authored
  41fe228View commit details

  Copy full SHA for 41fe228

  View code at this pointBrowse repository at this point

• Use `transformers` utilities when possible (#2064)

  Show description for 07f0e68
  qgallouedec

  authored
  07f0e68View commit details

  Copy full SHA for 07f0e68

  View code at this pointBrowse repository at this point

• Nash md (#1853)

  Show description for dc2bd07
  

  4 peopleauthored
  dc2bd07View commit details

  Copy full SHA for dc2bd07

  View code at this pointBrowse repository at this point

• [KTO] Overrides default `learning_rate` in `KTOConfig` (#2070)

  Show description for cdafc93
  

  kashif

  and

  qgallouedec

  authored
  cdafc93View commit details

  Copy full SHA for cdafc93

  View code at this pointBrowse repository at this point

Commits on Sep 14, 2024

• Standardizing datasets for testing (#2065)

  Show description for 40f0522
  qgallouedec

  authored
  40f0522View commit details

  Copy full SHA for 40f0522

  View code at this pointBrowse repository at this point

• remove min_new_tokens=args.max_new_tokens (#2069)

  kashif

  authored
  f6c6643View commit details

  Copy full SHA for f6c6643

  View code at this pointBrowse repository at this point

Commits on Sep 13, 2024

• PEFT support for Online DPO (#2041)

  Show description for ebc85b2
  

  qgallouedec

  and

  lewtun

  authored
  ebc85b2View commit details

  Copy full SHA for ebc85b2

  View code at this pointBrowse repository at this point

• Standardise API for `WinRateCallback` and `LogCompletionsCallback` (#2061)

  Show description for 88bede6
  lewtun

  authored
  88bede6View commit details

  Copy full SHA for 88bede6

  View code at this pointBrowse repository at this point

• Shuffle examples before they are packed (#2037)

  Show description for 7a2bbe3
  

  muupan

  and

  lewtun

  authored
  7a2bbe3View commit details

  Copy full SHA for 7a2bbe3

  View code at this pointBrowse repository at this point

• Support for `SFTTrainer.evaluate()` and `SFTTrainer.predict()` with null train_dataset (#2004)

  Show description for d832492
  

  Sohaib9920

  and

  lewtun

  authored
  d832492View commit details

  Copy full SHA for d832492

  View code at this pointBrowse repository at this point

• ©️ Copyrights (#2063)

  Show description for 4c92ba5
  qgallouedec

  authored
  4c92ba5View commit details

  Copy full SHA for 4c92ba5

  View code at this pointBrowse repository at this point

• Mask loss in gkd when generating from the student (#2058)

  Show description for a5b98fc
  

  gaetanlop

  and

  kashif

  authored
  a5b98fcView commit details

  Copy full SHA for a5b98fc

  View code at this pointBrowse repository at this point

Commits on Sep 11, 2024

• Add missing autodocs (#2056)

  qgallouedec

  authored
  e51a5acView commit details

  Copy full SHA for e51a5ac

  View code at this pointBrowse repository at this point

• 📝 Document dataset format (#2020)

  Show description for 31b9387
  

  qgallouedec

  and

  lewtun

  authored
  31b9387View commit details

  Copy full SHA for 31b9387

  View code at this pointBrowse repository at this point

• Gkd trainer (#1814)

  Show description for 85696aa
  

  3 peopleauthored
  85696aaView commit details

  Copy full SHA for 85696aa

  View code at this pointBrowse repository at this point

• Clean up DPO example (#2043)

  Show description for 9a6061f
  lewtun

  authored
  9a6061fView commit details

  Copy full SHA for 9a6061f

  View code at this pointBrowse repository at this point

• Remove `RichProgressCallback` from examples (#2053)

  Show description for a8fd6dc
  lewtun

  authored
  a8fd6dcView commit details

  Copy full SHA for a8fd6dc

  View code at this pointBrowse repository at this point