Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Mar 27, 2024

• Update KTO example to use better model and ChatML support (#1485)

  Show description for 0ee349d
  lewtun

  authored
  0ee349dView commit details

  Copy full SHA for 0ee349d

  Browse repository at this point

• Ignore chat files (#1486)

  Show description for 7ff6206
  

  lewtun

  and

  lvwerra

  authored
  7ff6206View commit details

  Copy full SHA for 7ff6206

  Browse repository at this point

• hackey update to ModelConfig to allow lora_target_modules="all-linear" (#1488)

  Show description for e4b20ec
  galtay

  authored
  e4b20ecView commit details

  Copy full SHA for e4b20ec

  Browse repository at this point

Commits on Mar 26, 2024

• [KTO] Use batching to speed up data processing (#1470)

  Show description for 6c2f829
  lewtun

  authored
  6c2f829View commit details

  Copy full SHA for 6c2f829

  Browse repository at this point

Commits on Mar 25, 2024

• Update KTO example with good dataset & chat format (#1481)

  Show description for c4f0f41
  lewtun

  authored
  c4f0f41View commit details

  Copy full SHA for c4f0f41

  Browse repository at this point

Commits on Mar 24, 2024

• add missing classes (#1479)

  anakin87

  authored
  dc6a934View commit details

  Copy full SHA for dc6a934

  Browse repository at this point

• Fix hyperparameters in KTO example (#1474)

  Show description for 9ce7ac6
  lewtun

  authored
  9ce7ac6View commit details

  Copy full SHA for 9ce7ac6

  Browse repository at this point

• Add `use_cache=False` in `{ORPO,CPO}Trainer.concatenated_forward` (#1478)

  Show description for 99553c1
  

  alvarobartt

  and

  kashif

  authored
  99553c1View commit details

  Copy full SHA for 99553c1

  Browse repository at this point

Commits on Mar 22, 2024

• ORPO trainer (#1435)

  Show description for 2ce8e45
  

  3 peopleauthored
  2ce8e45View commit details

  Copy full SHA for 2ce8e45

  Browse repository at this point

• Add CPOTrainer (#1382)

  Show description for d1df79f
  

  3 peopleauthored
  d1df79fView commit details

  Copy full SHA for d1df79f

  Browse repository at this point

• [peft] Update test_reward_trainer.py to fix tests (#1471)

  Show description for d10f766
  kashif

  authored
  d10f766View commit details

  Copy full SHA for d10f766

  Browse repository at this point

Commits on Mar 20, 2024

• Use the standard dataset for DPO CLI (#1456)

  Show description for 423991c
  vwxyzjn

  authored
  423991cView commit details

  Copy full SHA for 423991c

  Browse repository at this point

• set dev version (#1463)

  younesbelkada

  authored
  988d4c4View commit details

  Copy full SHA for 988d4c4

  Browse repository at this point

• Release: v0.8.1 (#1462)

  younesbelkada

  authored
  8534f0eView commit details

  Copy full SHA for 8534f0e

  Browse repository at this point

• add eos token to generate (#1459)

  lvwerra

  authored
  5095e7fView commit details

  Copy full SHA for 5095e7f

  Browse repository at this point

• Fix chat CLI for model revisions (#1458)

  Show description for 9fcf61d
  lewtun

  authored
  9fcf61dView commit details

  Copy full SHA for 9fcf61d

  Browse repository at this point

Commits on Mar 19, 2024

• set dev version (#1454)

  younesbelkada

  authored
  66b043aView commit details

  Copy full SHA for 66b043a

  Browse repository at this point

• Release: v0.8.0 (#1453)

  Show description for f2c7177
  younesbelkada

  authored
  f2c7177View commit details

  Copy full SHA for f2c7177

  Browse repository at this point

• FEAT: Update README to add DPO + CLIs (#1448)

  Show description for 631c33c
  

  younesbelkada

  and

  leandro

  authored
  631c33cView commit details

  Copy full SHA for 631c33c

  Browse repository at this point

• `model` --> `model_name_or_path` (#1452)

  Show description for 3f7ff60
  lvwerra

  authored
  3f7ff60View commit details

  Copy full SHA for 3f7ff60

  Browse repository at this point

• Fix yaml parsing issue (#1450)

  younesbelkada

  authored
  1705aebView commit details

  Copy full SHA for 1705aeb

  Browse repository at this point

• chat cli (#1431)

  Show description for 4e622a9
  lvwerra

  authored
  4e622a9View commit details

  Copy full SHA for 4e622a9

  Browse repository at this point

• CI / CLI: Properly raise error when CLI tests failed (#1446)

  Show description for eb2d5b2
  younesbelkada

  authored
  eb2d5b2View commit details

  Copy full SHA for eb2d5b2

  Browse repository at this point

• Before update the tr_loss, make sure tr_loss_step is in the same device. (#1439)

  Show description for f976c6d
  

  pengwei715

  and

  guy1992l

  authored
  f976c6dView commit details

  Copy full SHA for f976c6d

  Browse repository at this point

• Fix PPOTrainer README example (#1441)

  Show description for abc7301
  nikihowe

  authored
  abc7301View commit details

  Copy full SHA for abc7301

  Browse repository at this point

Commits on Mar 18, 2024

• fix doc build on main (#1437)

  younesbelkada

  authored
  6cfa5cfView commit details

  Copy full SHA for 6cfa5cf

  Browse repository at this point

• FEAT: Add CLIs in TRL ! (#1419)

  Show description for a2aa0f0
  

  younesbelkada

  and

  lvwerra

  authored
  a2aa0f0View commit details

  Copy full SHA for a2aa0f0

  Browse repository at this point

Commits on Mar 14, 2024

• Create standard dataset for TRL (#1424)

  Show description for 304e208
  vwxyzjn

  authored
  304e208View commit details

  Copy full SHA for 304e208

  Browse repository at this point

• [Kto] torch_dtype kwargs fix (#1429)

  Show description for 4fe8b02
  kashif

  authored
  4fe8b02View commit details

  Copy full SHA for 4fe8b02

  Browse repository at this point

• [KTO] fix tokenization bugs (#1418)

  Show description for fb6ebb1
  

  3 peopleauthored
  fb6ebb1View commit details

  Copy full SHA for fb6ebb1

  Browse repository at this point

Commits on Mar 13, 2024

• CI: Fix CI on main (#1422)

  Show description for 66078c7
  younesbelkada

  authored
  66078c7View commit details

  Copy full SHA for 66078c7

  Browse repository at this point

• Add support for FSDP+QLoRA and DeepSpeed ZeRO3+QLoRA (#1416)

  Show description for 58c0888
  

  pacman100

  and

  younesbelkada

  authored
  58c0888View commit details

  Copy full SHA for 58c0888

  Browse repository at this point

Commits on Mar 11, 2024

• model init when args are given (#1413)

  Show description for 486e7a4
  

  kashif

  and

  lewtun

  authored
  486e7a4View commit details

  Copy full SHA for 486e7a4

  Browse repository at this point

• Fix import error from deprecation in transformers (#1415)

  Show description for 7630f87
  lewtun

  authored
  7630f87View commit details

  Copy full SHA for 7630f87

  Browse repository at this point

Commits on Mar 8, 2024

• [KTO] fix various bugs (#1402)

  Show description for 4d862da
  

  3 peopleauthored
  4d862daView commit details

  Copy full SHA for 4d862da

  Browse repository at this point