Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Oct 4, 2024

• Conversational dataset support for `CPOTrainer` (#2144)

  Show description for d45c86e
  

  qgallouedec

  and

  lewtun

  authored
  d45c86eView commit details

  Copy full SHA for d45c86e

  Browse repository at this point

• 🗑️ Set deprecation version for DPO and SFT arguments to version 0.13 (#2170)

  qgallouedec

  authored
  c6b0d13View commit details

  Copy full SHA for c6b0d13

  Browse repository at this point

• Update trl version in CITATION.cff (#2171)

  qgallouedec

  authored
  3321084View commit details

  Copy full SHA for 3321084

  Browse repository at this point

• Default `dataset_text_field` to `"text"` (#2078)

  Show description for a9cffc7
  qgallouedec

  authored
  a9cffc7View commit details

  Copy full SHA for a9cffc7

  Browse repository at this point

• 🏷️ Model badges in trainer documentation (#2160)

  qgallouedec

  authored
  32a928cView commit details

  Copy full SHA for 32a928c

  Browse repository at this point

• Fix typo in error message (#2168)

  Show description for 1a3bb37
  eltociear

  authored
  1a3bb37View commit details

  Copy full SHA for 1a3bb37

  Browse repository at this point

Commits on Oct 3, 2024

• ↩️ Revert tokenizer hotfix #2163

  qgallouedec

  authored
  d4564b7View commit details

  Copy full SHA for d4564b7

  Browse repository at this point

• 🩹 [Hotfix] Add setter for tokenizer (#2163)

  qgallouedec

  authored
  1be4d86View commit details

  Copy full SHA for 1be4d86

  Browse repository at this point

Commits on Oct 2, 2024

• Conversational dataset support for `DPOTrainer` (#2131)

  Show description for 78249d9
  

  3 peopleauthored
  78249d9View commit details

  Copy full SHA for 78249d9

  Browse repository at this point

Commits on Oct 1, 2024

• [CI] Don't use `eval_strategy="steps"` when no eval dataset (#2152)

  Show description for 5c21de3
  qgallouedec

  authored
  5c21de3View commit details

  Copy full SHA for 5c21de3

  Browse repository at this point

• 🩹 Fix attention mask warning in chat CLI (#2147)

  Show description for 0a566f0
  qgallouedec

  authored
  0a566f0View commit details

  Copy full SHA for 0a566f0

  Browse repository at this point

Commits on Sep 30, 2024

• [GKD] Set custom EOS tokens in generation config (#2142)

  Show description for de38765
  

  lewtun

  and

  qgallouedec

  authored
  de38765View commit details

  Copy full SHA for de38765

  Browse repository at this point

Commits on Sep 27, 2024

• rename example (#2139)

  qgallouedec

  authored
  1201aa6View commit details

  Copy full SHA for 1201aa6

  Browse repository at this point

• 🃏 Model card for TRL (#2123)

  Show description for c00722c
  

  qgallouedec

  and

  lewtun

  authored
  c00722cView commit details

  Copy full SHA for c00722c

  Browse repository at this point

• Add correct label for `WinRateCallback` table (#2134)

  Show description for 124189c
  lewtun

  authored
  124189cView commit details

  Copy full SHA for 124189c

  Browse repository at this point

• arXiv to HF papers (#2133)

  qgallouedec

  authored
  d5eeaabView commit details

  Copy full SHA for d5eeaab

  Browse repository at this point

Commits on Sep 26, 2024

• 🧹 Style (#2132)

  Show description for 5368be1
  qgallouedec

  authored
  5368be1View commit details

  Copy full SHA for 5368be1

  Browse repository at this point

• Add table for WinRateCallback (#2116)

  Show description for b169e10
  

  lewtun

  and

  qgallouedec

  authored
  b169e10View commit details

  Copy full SHA for b169e10

  Browse repository at this point

• ♻️ Standardize `script_args` (#2130)

  qgallouedec

  authored
  9af4734View commit details

  Copy full SHA for 9af4734

  Browse repository at this point

• Tokenize row during in `training_step` in `OnlineDPOTrainer` (#2117)

  Show description for a0d7149
  

  qgallouedec

  and

  lewtun

  authored
  a0d7149View commit details

  Copy full SHA for a0d7149

  Browse repository at this point

• Eos token encouragement Clarification (#2128)

  Show description for a0e2814
  August-murr

  authored
  a0e2814View commit details

  Copy full SHA for a0e2814

  Browse repository at this point

• Standardize pushing to Hub in examples (#2126)

  qgallouedec

  authored
  32d9d34View commit details

  Copy full SHA for 32d9d34

  Browse repository at this point

• Remove `max_length` from `RewardDataCollatorWithPadding` (#2119)

  qgallouedec

  authored
  fb1b48fView commit details

  Copy full SHA for fb1b48f

  Browse repository at this point

Commits on Sep 25, 2024

• Update example_overview.md (#2125)

  kashif

  authored
  b5e4bc5View commit details

  Copy full SHA for b5e4bc5

  Browse repository at this point

• Generalizes VSFT script to support REDACTED (#2120)

  Show description for 7a24565
  

  edbeeching

  and

  kashif

  authored
  7a24565View commit details

  Copy full SHA for 7a24565

  Browse repository at this point

Commits on Sep 24, 2024

• `BCOTrainer` conversational dataset support (#2107)

  Show description for 44a06fc
  

  qgallouedec

  and

  lewtun

  authored
  44a06fcView commit details

  Copy full SHA for 44a06fc

  Browse repository at this point

• Fix packing test (#2111)

  Show description for a84fc5d
  qgallouedec

  authored
  a84fc5dView commit details

  Copy full SHA for a84fc5d

  Browse repository at this point

• [online-dpo] allow parse-args as list of floats (#2108)

  Show description for 80038a5
  

  kashif

  and

  qgallouedec

  authored
  80038a5View commit details

  Copy full SHA for 80038a5

  Browse repository at this point

• fix formatting (#2109)

  Show description for cece86b
  kashif

  authored
  cece86bView commit details

  Copy full SHA for cece86b

  Browse repository at this point

• Fix documentation links (#2105)

  qgallouedec

  authored
  d005980View commit details

  Copy full SHA for d005980

  Browse repository at this point

• [`RewardTrainer`] Tokenize inputs within trainer (#2102)

  Show description for cc23b51
  

  lewtun

  and

  qgallouedec

  authored
  cc23b51View commit details

  Copy full SHA for cc23b51

  Browse repository at this point

• [CLI] `trl env` for printing system info (#2104)

  qgallouedec

  authored
  2cad48dView commit details

  Copy full SHA for 2cad48d

  Browse repository at this point

Commits on Sep 23, 2024

• Fix PPO/RLOO examples (#2100)

  lewtun

  authored
  6859e04View commit details

  Copy full SHA for 6859e04

  Browse repository at this point

• Clean up README and remove openrlbenchmark dependency (#2085)

  Show description for 92eea1f
  

  lewtun

  and

  qgallouedec

  authored
  92eea1fView commit details

  Copy full SHA for 92eea1f

  Browse repository at this point

Commits on Sep 21, 2024

• KTO: fix logits metric, add logits metric to BCOTrainer too (#2094)

  Show description for 663002f
  

  claralp

  and

  Clara Luise Pohland

  authored
  663002fView commit details

  Copy full SHA for 663002f

  Browse repository at this point