Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Aug 14, 2023

• Disable dropout in DPO Training (#639)

  Show description for 98120d6
  nmntz

  authored
  98120d6View commit details

  Copy full SHA for 98120d6

  Browse repository at this point

Commits on Aug 10, 2023

• Add score scaling/normalization/clipping (#560)

  Show description for 3b2c820
  zfang

  authored
  3b2c820View commit details

  Copy full SHA for 3b2c820

  Browse repository at this point

Commits on Aug 9, 2023

• Move repo (#628)

  Show description for 25fd6f2
  lvwerra

  authored
  25fd6f2View commit details

  Copy full SHA for 25fd6f2

  Browse repository at this point

Commits on Aug 8, 2023

• Improve docs (#612)

  Show description for 3f1477c
  lvwerra

  authored
  3f1477cView commit details

  Copy full SHA for 3f1477c

  Browse repository at this point

• Allow already tokenized sequences for `response_template` in `DataCollatorForCompletionOnlyLM` (#622)

  Show description for 2cff1e4
  

  ivsanro1

  and

  ivsanro2

  authored
  2cff1e4View commit details

  Copy full SHA for 2cff1e4

  Browse repository at this point

• use log_with argument (#620)

  hitorilabs

  authored
  d7d7902View commit details

  Copy full SHA for d7d7902

  Browse repository at this point

Commits on Aug 7, 2023

• [DPO] stack-llama-2 training scripts (#611)

  Show description for 77b0cc1
  kashif

  authored
  77b0cc1View commit details

  Copy full SHA for 77b0cc1

  Browse repository at this point

Commits on Aug 4, 2023

• Add docs explaining logged metrics (#616)

  vwxyzjn

  authored
  17f22c1View commit details

  Copy full SHA for 17f22c1

  Browse repository at this point

Commits on Aug 3, 2023

• [`Modeling`] Add token support for `hf_hub_download` (#604)

  Show description for e448bb6
  younesbelkada

  authored
  e448bb6View commit details

  Copy full SHA for e448bb6

  Browse repository at this point

Commits on Aug 2, 2023

• set dev version (#608)

  younesbelkada

  authored
  9aa4e3cView commit details

  Copy full SHA for 9aa4e3c

  Browse repository at this point

• Release: 0.5.0 (#607)

  younesbelkada

  authored
  ca8a508View commit details

  Copy full SHA for ca8a508

  Browse repository at this point

Commits on Aug 1, 2023

• refactor grad accum (#546)

  Show description for a00ab44
  vwxyzjn

  authored
  a00ab44View commit details

  Copy full SHA for a00ab44

  Browse repository at this point

Commits on Jul 31, 2023

• Fix comparison in DataCollatorForCompletionOnlyLM (#588) (#594)

  Show description for 431f0c9
  RyujiTamaki

  authored
  431f0c9View commit details

  Copy full SHA for 431f0c9

  Browse repository at this point

Commits on Jul 28, 2023

• docs: Replace SFTTrainer with RewardTrainer in comment (#589)

  Show description for 64bc9bc
  tomaarsen

  authored
  64bc9bcView commit details

  Copy full SHA for 64bc9bc

  Browse repository at this point

• Introducing DataCollatorForChatCompletionOnlyLM (#456)

  Show description for 5a1e1bf
  

  gaetanlop

  and

  younesbelkada

  authored
  5a1e1bfView commit details

  Copy full SHA for 5a1e1bf

  Browse repository at this point

• Update the example sft_trainer.py (#587)

  Show description for e8dd810
  ZeusFSX

  authored
  e8dd810View commit details

  Copy full SHA for e8dd810

  Browse repository at this point

• [`PPO`] fix corner cases with PPO batch size and forward_batch_size (#563)

  Show description for 1b46c61
  

  3 peopleauthored
  1b46c61View commit details

  Copy full SHA for 1b46c61

  Browse repository at this point

Commits on Jul 27, 2023

• Add missing max_seq_length arg to example sft_trainer.py (#585)

  SharkWipf

  authored
  3b0a1b5View commit details

  Copy full SHA for 3b0a1b5

  Browse repository at this point

• Computes the KL penalty using the entire distribution (#541)

  Show description for 31658b4
  edbeeching

  authored
  31658b4View commit details

  Copy full SHA for 31658b4

  Browse repository at this point

Commits on Jul 26, 2023

• Fix model output dim in reward trainer example (#566)

  Show description for f7227fb
  liutianlin0121

  authored
  f7227fbView commit details

  Copy full SHA for f7227fb

  Browse repository at this point

• [`DPO`] Resolve logging for DPOTrainer (#570)

  Show description for b3c2e73
  tomaarsen

  authored
  b3c2e73View commit details

  Copy full SHA for b3c2e73

  Browse repository at this point

Commits on Jul 24, 2023

• Add comment to explain how the sentiment pipeline is used to run the … (#555)

  Show description for d78d917
  jvhoffbauer

  authored
  d78d917View commit details

  Copy full SHA for d78d917

  Browse repository at this point

• Add `DataCollatorForCompletionOnlyLM` in the docs (#565)

  Show description for cdde7f7
  younesbelkada

  authored
  cdde7f7View commit details

  Copy full SHA for cdde7f7

  Browse repository at this point

• add epochs and num steps on CLI (#562)

  younesbelkada

  authored
  51d5f08View commit details

  Copy full SHA for 51d5f08

  Browse repository at this point

• Minor typo and whitespace fixes (#559)

  Show description for 8762507
  tmm1

  authored
  8762507View commit details

  Copy full SHA for 8762507

  Browse repository at this point

• remove unused batch_size arg (#554)

  kashif

  authored
  1bd852aView commit details

  Copy full SHA for 1bd852a

  Browse repository at this point

Commits on Jul 22, 2023

• [`SFTTrainer`] Add warning for wrong padding_side (#550)

  Show description for 170d58f
  younesbelkada

  authored
  170d58fView commit details

  Copy full SHA for 170d58f

  Browse repository at this point

Commits on Jul 20, 2023

• ADD: num_proc to SFTTrainer (#547)

  Show description for 84c9209
  

  3 peopleauthored
  84c9209View commit details

  Copy full SHA for 84c9209

  Browse repository at this point

Commits on Jul 19, 2023

• Add `use_auth_token` arg to sft_trainer example (#544)

  Show description for d0fe348
  

  corey-lambda

  and

  lvwerra

  authored
  d0fe348View commit details

  Copy full SHA for d0fe348

  Browse repository at this point

• [`examples`] make the sft script more modulable (#543)

  Show description for 5857d0a
  younesbelkada

  authored
  5857d0aView commit details

  Copy full SHA for 5857d0a

  Browse repository at this point

• [DPO] remove response/pairs from the DPO side (#540)

  Show description for fd50e06
  

  3 peopleauthored
  fd50e06View commit details

  Copy full SHA for fd50e06

  Browse repository at this point

• Relax reward trainer constraint (#539)

  Show description for bcff7c2
  

  younesbelkada

  and

  tomaarsen

  authored
  bcff7c2View commit details

  Copy full SHA for bcff7c2

  Browse repository at this point

• fix offline case (#538)

  younesbelkada

  authored
  0e8d9f8View commit details

  Copy full SHA for 0e8d9f8

  Browse repository at this point

Commits on Jul 18, 2023

• all the concated batches are on same device (#528)

  kashif

  authored
  7f297b3View commit details

  Copy full SHA for 7f297b3

  Browse repository at this point

Commits on Jul 17, 2023

• DPO Trainer (#416)

  Show description for 84393f3
  

  4 peopleauthored
  84393f3View commit details

  Copy full SHA for 84393f3

  Browse repository at this point