Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jun 29, 2024

• Fixed typo in SFT trainer docs (#1788)

  Show description for cd85b14
  detsutut

  authored
  cd85b14View commit details

  Copy full SHA for cd85b14

  Browse repository at this point

Commits on Jun 27, 2024

• fix docs and examples (#1780)

  kashif

  authored
  a57544fView commit details

  Copy full SHA for a57544f

  Browse repository at this point

Commits on Jun 26, 2024

• Visual DPO (#1647)

  Show description for b68ff96
  

  qgallouedec

  and

  kashif

  authored
  b68ff96View commit details

  Copy full SHA for b68ff96

  Browse repository at this point

• Fix Documentation Overflow Issues for Long URLs in SFTConfig (#1774)

  Show description for c8c01cc
  Mubin17

  authored
  c8c01ccView commit details

  Copy full SHA for c8c01cc

  Browse repository at this point

• Remove the leading space in the tldr preference dataset (#1773)

  vwxyzjn

  authored
  3479606View commit details

  Copy full SHA for 3479606

  Browse repository at this point

Commits on Jun 25, 2024

• add Efficient Exact Optimization (EXO) (#1735)

  Show description for 7965b78
  

  haozheji

  and

  kashif

  authored
  7965b78View commit details

  Copy full SHA for 7965b78

  Browse repository at this point

• `evaluation_strategy` to `eval_strategy` (#1771)

  Show description for 56bd1bb
  qgallouedec

  authored
  56bd1bbView commit details

  Copy full SHA for 56bd1bb

  Browse repository at this point

Commits on Jun 24, 2024

• MoE Models: option to add load balancing loss (#1765)

  Show description for 94d53e6
  

  claralp

  and

  Clara Luise Pohland

  authored
  94d53e6View commit details

  Copy full SHA for 94d53e6

  Browse repository at this point

• Added Reward Backpropogation Support (#1585)

  Show description for b5be100
  

  mihirp1998

  and

  younesbelkada

  authored
  b5be100View commit details

  Copy full SHA for b5be100

  Browse repository at this point

Commits on Jun 23, 2024

• Add CPO-SimPO method (#1760)

  Show description for 6e1652b
  

  fe1ixxu

  and

  kashif

  authored
  6e1652bView commit details

  Copy full SHA for 6e1652b

  Browse repository at this point

Commits on Jun 21, 2024

• New sentiment and descriptiveness dataset (#1757)

  Show description for 65374c6
  vwxyzjn

  authored
  65374c6View commit details

  Copy full SHA for 65374c6

  Browse repository at this point

• Add dataset_text_field in examples/scripts/sft.py (#1758)

  juyoungml

  authored
  9956091View commit details

  Copy full SHA for 9956091

  Browse repository at this point

Commits on Jun 20, 2024

• Support num_train_epochs (#1743)

  Show description for 34d273f
  vwxyzjn

  authored
  34d273fView commit details

  Copy full SHA for 34d273f

  Browse repository at this point

• Fix masking of response tokens (#1718)

  Show description for 3bf9449
  mertsayar8

  authored
  3bf9449View commit details

  Copy full SHA for 3bf9449

  Browse repository at this point

• Support for returning past_key_values from the model (#1742)

  Show description for ba6abee
  idanshen

  authored
  ba6abeeView commit details

  Copy full SHA for ba6abee

  Browse repository at this point

Commits on Jun 19, 2024

• Integrate f-divergence to DPO (Follow up) (#1610)

  Show description for a57e759
  

  1485840691

  and

  kashif

  authored
  a57e759View commit details

  Copy full SHA for a57e759

  Browse repository at this point

Commits on Jun 18, 2024

• change the `process` function in the example of DPO (#1753)

  Show description for ae23d40
  AIR-hl

  authored
  ae23d40View commit details

  Copy full SHA for ae23d40

  Browse repository at this point

• CI / `KTOTrainer`: Remove old tests (#1750)

  Show description for 83b367b
  younesbelkada

  authored
  83b367bView commit details

  Copy full SHA for 83b367b

  Browse repository at this point

Commits on Jun 17, 2024

• prepare deepspeed accomodate fp16 and bf16 (#1728)

  Show description for d1ed730
  mnoukhov

  authored
  d1ed730View commit details

  Copy full SHA for d1ed730

  Browse repository at this point

• CPO / DPO: Fix red CI (#1749)

  Show description for 8f8e95e
  younesbelkada

  authored
  8f8e95eView commit details

  Copy full SHA for 8f8e95e

  Browse repository at this point

• fix red CI

  younesbelkada

  authored
  4e23d95View commit details

  Copy full SHA for 4e23d95

  Browse repository at this point

• small KTO fixes (#1734)

  Show description for 50c4620
  

  4 peopleauthored
  50c4620View commit details

  Copy full SHA for 50c4620

  Browse repository at this point

• `TrlParser`: Add ignore extra args option (#1748)

  Show description for 6105d03
  younesbelkada

  authored
  6105d03View commit details

  Copy full SHA for 6105d03

  Browse repository at this point

• CI / core: Pin `numpy` to `!=2.0.0` for CI and to users (#1747)

  Show description for e247bbd
  younesbelkada

  authored
  e247bbdView commit details

  Copy full SHA for e247bbd

  Browse repository at this point

• better trl parser with yaml config (#1739)

  Show description for 3d04496
  mnoukhov

  authored
  3d04496View commit details

  Copy full SHA for 3d04496

  Browse repository at this point

• Workflow: Notify tests results on slack channel (#1744)

  Show description for 2d244f8
  younesbelkada

  authored
  2d244f8View commit details

  Copy full SHA for 2d244f8

  Browse repository at this point

Commits on Jun 12, 2024

• adds AOT (#1701)

  Show description for f5168fd
  

  imelnyk

  and

  Igor Melnyk

  authored
  f5168fdView commit details

  Copy full SHA for f5168fd

  Browse repository at this point

Commits on Jun 11, 2024

• ktotrainer: Refuse datasets which contain only one class of labels (#1724)

  Show description for 79686e1
  jetlime

  authored
  79686e1View commit details

  Copy full SHA for 79686e1

  Browse repository at this point

Commits on Jun 10, 2024

• feat(ci): add trufflehog secrets detection (#1721)

  Show description for 34ebc4c
  McPatate

  authored
  34ebc4cView commit details

  Copy full SHA for 34ebc4c

  Browse repository at this point

Commits on Jun 7, 2024

• Fix default padding_value in dpo_config.py (#1692)

  Show description for 1d84e2b
  mnoukhov

  authored
  1d84e2bView commit details

  Copy full SHA for 1d84e2b

  Browse repository at this point

• fix yaml parser for derived config classes (#1713)

  Show description for 2f71b8b
  mnoukhov

  authored
  2f71b8bView commit details

  Copy full SHA for 2f71b8b

  Browse repository at this point

• RDPO fix nll loss (#1705)

  kashif

  authored
  5bcb8adView commit details

  Copy full SHA for 5bcb8ad

  Browse repository at this point

Commits on Jun 6, 2024

• Add a variant of CPO, SimPO (#1703)

  Show description for b8b972f
  

  fe1ixxu

  and

  kashif

  authored
  b8b972fView commit details

  Copy full SHA for b8b972f

  Browse repository at this point

• set dev version (#1710)

  Show description for 3eb9ccb
  younesbelkada

  authored
  3eb9ccbView commit details

  Copy full SHA for 3eb9ccb

  Browse repository at this point

• 0.9.4 release (#1708)

  vwxyzjn

  authored
  974b0d3View commit details

  Copy full SHA for 974b0d3

  Browse repository at this point