Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on May 29, 2024

• Fix max completion length (#1588)

  samuki

  authored
  151a452View commit details

  Copy full SHA for 151a452

  Browse repository at this point

• fix (#1678)

  younesbelkada

  authored
  488b502View commit details

  Copy full SHA for 488b502

  Browse repository at this point

Commits on May 27, 2024

• fix dataset load error (#1670)

  Show description for 3c0a10b
  sywangyi

  authored
  3c0a10bView commit details

  Copy full SHA for 3c0a10b

  Browse repository at this point

Commits on May 24, 2024

• FIX / PPO: Fix `enable_input_require_grads` issues with PPO models (#1664)

  Show description for b031adf
  younesbelkada

  authored
  b031adfView commit details

  Copy full SHA for b031adf

  Browse repository at this point

Commits on May 23, 2024

• Fix ppov2 test case (#1661)

  Show description for e7cb597
  vwxyzjn

  authored
  e7cb597View commit details

  Copy full SHA for e7cb597

  Browse repository at this point

• update eval_strategy (#1662)

  kashif

  authored
  bc8dfbfView commit details

  Copy full SHA for bc8dfbf

  Browse repository at this point

• do not upcast adapters when using FSDP+QLoRA (#1654)

  pacman100

  authored
  e4ed7a3View commit details

  Copy full SHA for e4ed7a3

  Browse repository at this point

• 🤫 TR-DPO implementation (#1593)

  Show description for 9a7efbd
  

  4 peopleauthored
  9a7efbdView commit details

  Copy full SHA for 9a7efbd

  Browse repository at this point

• [DPO] Add 'robust' loss_type (#1653)

  Show description for b344bce
  Abilityguy

  authored
  b344bceView commit details

  Copy full SHA for b344bce

  Browse repository at this point

• Fix inheritance order in PPOv2Config (#1659)

  Show description for 35e12dc
  Nicolinho

  authored
  35e12dcView commit details

  Copy full SHA for 35e12dc

  Browse repository at this point

• docs: correct cDPO usage in DPOTrainer (#1655)

  AliBakly

  authored
  1da6be1View commit details

  Copy full SHA for 1da6be1

  Browse repository at this point

• add support for training collator (#1658)

  younesbelkada

  authored
  e249cd8View commit details

  Copy full SHA for e249cd8

  Browse repository at this point

• Apply deprecated `evaluation_strategy` (#1559)

  Show description for a02513c
  

  muellerzr

  and

  kashif

  authored
  a02513cView commit details

  Copy full SHA for a02513c

  Browse repository at this point

Commits on May 22, 2024

• PPO / Reinforce Trainers (#1540)

  Show description for 13454d2
  vwxyzjn

  authored
  13454d2View commit details

  Copy full SHA for 13454d2

  Browse repository at this point

Commits on May 15, 2024

• don't cast the trainable lora layers to half precision (#1644)

  Show description for 99f2c94
  pacman100

  authored
  99f2c94View commit details

  Copy full SHA for 99f2c94

  Browse repository at this point

Commits on May 14, 2024

• Pairwise Noise Contrastive Alignment (#1632)

  Show description for 6401d08
  

  winglian

  and

  younesbelkada

  authored
  6401d08View commit details

  Copy full SHA for 6401d08

  Browse repository at this point

• Fixed wrong logs prefixes in KTOTrainer (#1641)

  Show description for d632a5b
  bartoszzuk

  authored
  d632a5bView commit details

  Copy full SHA for d632a5b

  Browse repository at this point

Commits on May 10, 2024

• Update sft_llama2.py to work with the latest API (#1637)

  Show description for 5aeb752
  xianbaoqian

  authored
  5aeb752View commit details

  Copy full SHA for 5aeb752

  Browse repository at this point

• [ORPO] Correct label mask for pad tokens (#1625)

  Show description for b8b8978
  

  IlyaGusev

  and

  kashif

  authored
  b8b8978View commit details

  Copy full SHA for b8b8978

  Browse repository at this point

• visualize rm prediction (#1636)

  Show description for 8799952
  vwxyzjn

  authored
  8799952View commit details

  Copy full SHA for 8799952

  Browse repository at this point

Commits on May 3, 2024

• fixed adding bos and eos token unconditionally (#1591)

  Show description for 3b4c249
  jasonyux

  authored
  3b4c249View commit details

  Copy full SHA for 3b4c249

  Browse repository at this point

• Fix ZeRO-3 generation context manager (#1617)

  lewtun

  authored
  0347f58View commit details

  Copy full SHA for 0347f58

  Browse repository at this point

• corrects loss function for Self-play Preference Optimization hard label version (#1615)

  Show description for 75de236
  angelahzyuan

  authored
  75de236View commit details

  Copy full SHA for 75de236

  Browse repository at this point

Commits on May 2, 2024

• Update HH dataset on helpful only subset (#1613)

  Show description for 7075cec
  vwxyzjn

  authored
  7075cecView commit details

  Copy full SHA for 7075cec

  Browse repository at this point

• support loss function for Self-play Preference Optimization (#1612)

  Show description for adf17a5
  

  winglian

  and

  kashif

  authored
  adf17a5View commit details

  Copy full SHA for adf17a5

  Browse repository at this point

• Docs: Fix build main documentation (#1604)

  Show description for 0d40e18
  younesbelkada

  authored
  0d40e18View commit details

  Copy full SHA for 0d40e18

  Browse repository at this point

• Excluding tests from setup.py (#1607)

  jamesbraza

  authored
  683bc5aView commit details

  Copy full SHA for 683bc5a

  Browse repository at this point

• Use auto device map (#1596)

  lewtun

  authored
  5f09131View commit details

  Copy full SHA for 5f09131

  Browse repository at this point

Commits on Apr 30, 2024

• [`KTOTrainer`] add BCO (reward shift and underlying distribution matching) (#1599)

  Show description for d1aa0b6
  seanexp

  authored
  d1aa0b6View commit details

  Copy full SHA for d1aa0b6

  Browse repository at this point

• Update __init__.py (#1602)

  younesbelkada

  authored
  d88ec14View commit details

  Copy full SHA for d88ec14

  Browse repository at this point

Commits on Apr 29, 2024

• fix typo (#1594)

  qgallouedec

  authored
  6c18e40View commit details

  Copy full SHA for 6c18e40

  Browse repository at this point

Commits on Apr 23, 2024

• add warning in SFTTrainer (#1577)

  younesbelkada

  authored
  1d0a7eaView commit details

  Copy full SHA for 1d0a7ea

  Browse repository at this point

• FIX: Fix CI on transformers main (#1576)

  Show description for 9f68ead
  younesbelkada

  authored
  9f68eadView commit details

  Copy full SHA for 9f68ead

  Browse repository at this point

• [SFT] add SFT Trainer Config dataclass (#1530)

  Show description for f30daa4
  

  kashif

  and

  lewtun

  authored
  f30daa4View commit details

  Copy full SHA for f30daa4

  Browse repository at this point

• [DPO] DPOConfig class (#1554)

  Show description for 24fd8dd
  

  kashif

  and

  lewtun

  authored
  24fd8ddView commit details

  Copy full SHA for 24fd8dd

  Browse repository at this point