Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Sep 26, 2024

• ♻️ Standardize `script_args` (#2130)

  qgallouedec

  authored
  9af4734View commit details

  Copy full SHA for 9af4734

  Browse repository at this point

• Tokenize row during in `training_step` in `OnlineDPOTrainer` (#2117)

  Show description for a0d7149
  

  qgallouedec

  and

  lewtun

  authored
  a0d7149View commit details

  Copy full SHA for a0d7149

  Browse repository at this point

• Eos token encouragement Clarification (#2128)

  Show description for a0e2814
  August-murr

  authored
  a0e2814View commit details

  Copy full SHA for a0e2814

  Browse repository at this point

• Standardize pushing to Hub in examples (#2126)

  qgallouedec

  authored
  32d9d34View commit details

  Copy full SHA for 32d9d34

  Browse repository at this point

• Remove `max_length` from `RewardDataCollatorWithPadding` (#2119)

  qgallouedec

  authored
  fb1b48fView commit details

  Copy full SHA for fb1b48f

  Browse repository at this point

Commits on Sep 25, 2024

• Update example_overview.md (#2125)

  kashif

  authored
  b5e4bc5View commit details

  Copy full SHA for b5e4bc5

  Browse repository at this point

• Generalizes VSFT script to support REDACTED (#2120)

  Show description for 7a24565
  

  edbeeching

  and

  kashif

  authored
  7a24565View commit details

  Copy full SHA for 7a24565

  Browse repository at this point

Commits on Sep 24, 2024

• `BCOTrainer` conversational dataset support (#2107)

  Show description for 44a06fc
  

  qgallouedec

  and

  lewtun

  authored
  44a06fcView commit details

  Copy full SHA for 44a06fc

  Browse repository at this point

• Fix packing test (#2111)

  Show description for a84fc5d
  qgallouedec

  authored
  a84fc5dView commit details

  Copy full SHA for a84fc5d

  Browse repository at this point

• [online-dpo] allow parse-args as list of floats (#2108)

  Show description for 80038a5
  

  kashif

  and

  qgallouedec

  authored
  80038a5View commit details

  Copy full SHA for 80038a5

  Browse repository at this point

• fix formatting (#2109)

  Show description for cece86b
  kashif

  authored
  cece86bView commit details

  Copy full SHA for cece86b

  Browse repository at this point

• Fix documentation links (#2105)

  qgallouedec

  authored
  d005980View commit details

  Copy full SHA for d005980

  Browse repository at this point

• [`RewardTrainer`] Tokenize inputs within trainer (#2102)

  Show description for cc23b51
  

  lewtun

  and

  qgallouedec

  authored
  cc23b51View commit details

  Copy full SHA for cc23b51

  Browse repository at this point

• [CLI] `trl env` for printing system info (#2104)

  qgallouedec

  authored
  2cad48dView commit details

  Copy full SHA for 2cad48d

  Browse repository at this point

Commits on Sep 23, 2024

• Fix PPO/RLOO examples (#2100)

  lewtun

  authored
  6859e04View commit details

  Copy full SHA for 6859e04

  Browse repository at this point

• Clean up README and remove openrlbenchmark dependency (#2085)

  Show description for 92eea1f
  

  lewtun

  and

  qgallouedec

  authored
  92eea1fView commit details

  Copy full SHA for 92eea1f

  Browse repository at this point

Commits on Sep 21, 2024

• KTO: fix logits metric, add logits metric to BCOTrainer too (#2094)

  Show description for 663002f
  

  claralp

  and

  Clara Luise Pohland

  authored
  663002fView commit details

  Copy full SHA for 663002f

  Browse repository at this point

• Fix _process_tokens for empty prompts in KTOTrainer (#2093)

  Show description for 44d998b
  gabikadlecova

  authored
  44d998bView commit details

  Copy full SHA for 44d998b

  Browse repository at this point

• fix: device could be in meta, transformers#33154 (#2089)

  Show description for 9b80f3d
  fabianlim

  authored
  9b80f3dView commit details

  Copy full SHA for 9b80f3d

  Browse repository at this point

• Fix typo in orpo example. (#2092)

  skandermoalla

  authored
  2038e52View commit details

  Copy full SHA for 2038e52

  Browse repository at this point

Commits on Sep 19, 2024

• `training_args` for all `TrainingArguments` (#2082)

  qgallouedec

  authored
  10c2f63View commit details

  Copy full SHA for 10c2f63

  Browse repository at this point

• [SFT] fix neftune_noise_alpha in SFTTrainer (#1841)

  Show description for 9fb871f
  

  3 peopleauthored
  9fb871fView commit details

  Copy full SHA for 9fb871f

  Browse repository at this point

• Bump dev version

  lewtun

  committed
  3cec013View commit details

  Copy full SHA for 3cec013

  Browse repository at this point

• Fix DeepSpeed for `PPOv2Trainer.save` (#2080)

  qgallouedec

  authored
  cc80ac6View commit details

  Copy full SHA for cc80ac6

  Browse repository at this point

• Standardize dataset naming (#2081)

  Show description for 4c0c98d
  qgallouedec

  authored
  4c0c98dView commit details

  Copy full SHA for 4c0c98d

  Browse repository at this point

Commits on Sep 18, 2024

• [WIP] Fix `logits/chosen` and `logits/rejected` metrics in `KTOTrainer` (#2077)

  Show description for 0d2bee5
  PhilipMay

  authored
  0d2bee5View commit details

  Copy full SHA for 0d2bee5

  Browse repository at this point

• Conversational dataset support for Online DPO (#2075)

  Show description for 6920c2d
  qgallouedec

  authored
  6920c2dView commit details

  Copy full SHA for 6920c2d

  Browse repository at this point

• Use wrapped model for reference completions in `WinRateCallback` and set default `freq` to `eval_steps` in LogCompletionsCallback` (#2074)

  Show description for 4d82676
  

  lewtun

  and

  qgallouedec

  authored
  4d82676View commit details

  Copy full SHA for 4d82676

  Browse repository at this point

Commits on Sep 17, 2024

• `processor(prompt, images=image)` to `processor(images=image, text=prompt)` (#2076)

  Show description for c314383
  qgallouedec

  authored
  c314383View commit details

  Copy full SHA for c314383

  Browse repository at this point

• Added error when `ref_model` and `model` have same id (#2057)

  Show description for e74dbf2
  

  3 peopleauthored
  e74dbf2View commit details

  Copy full SHA for e74dbf2

  Browse repository at this point

Commits on Sep 16, 2024

• Minor doc fixes and comments (#2073)

  Show description for 41fe228
  qgallouedec

  authored
  41fe228View commit details

  Copy full SHA for 41fe228

  Browse repository at this point

• Use `transformers` utilities when possible (#2064)

  Show description for 07f0e68
  qgallouedec

  authored
  07f0e68View commit details

  Copy full SHA for 07f0e68

  Browse repository at this point

• Nash md (#1853)

  Show description for dc2bd07
  

  4 peopleauthored
  dc2bd07View commit details

  Copy full SHA for dc2bd07

  Browse repository at this point

• [KTO] Overrides default `learning_rate` in `KTOConfig` (#2070)

  Show description for cdafc93
  

  kashif

  and

  qgallouedec

  authored
  cdafc93View commit details

  Copy full SHA for cdafc93

  Browse repository at this point

Commits on Sep 14, 2024

• Standardizing datasets for testing (#2065)

  Show description for 40f0522
  qgallouedec

  authored
  40f0522View commit details

  Copy full SHA for 40f0522

  Browse repository at this point