Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Nov 6, 2023

• fix: dpo trainer ds config (#957)

  Show description for 8e9cae8
  mengban

  authored
  8e9cae8View commit details

  Copy full SHA for 8e9cae8

  Browse repository at this point

• Added support for custom EncoderDecoder models (#911)

  ribesstefano

  authored
  654543aView commit details

  Copy full SHA for 654543a

  Browse repository at this point

• Adds model kwargs to SFT and DPO trainers (#951)

  Show description for c273b18
  edbeeching

  authored
  c273b18View commit details

  Copy full SHA for c273b18

  Browse repository at this point

• [DPO] Merge initial peft model if trainer has a peft_config (#956)

  Show description for 6c6ff24
  kashif

  authored
  6c6ff24View commit details

  Copy full SHA for 6c6ff24

  Browse repository at this point

Commits on Nov 5, 2023

• Fix unwrapping peft models (#948)

  Show description for 6ff0fac
  kkteru

  authored
  6ff0facView commit details

  Copy full SHA for 6ff0fac

  Browse repository at this point

Commits on Nov 3, 2023

• [`CI`] Fix CI with new transformers release (#946)

  Show description for 951ca18
  younesbelkada

  authored
  951ca18View commit details

  Copy full SHA for 951ca18

  Browse repository at this point

Commits on Nov 2, 2023

• Introducing the Iterative Trainer (#737)

  Show description for cc1de98
  gaetanlop

  authored
  cc1de98View commit details

  Copy full SHA for cc1de98

  Browse repository at this point

• Update dpo_trainer.py (#941)

  younesbelkada

  authored
  a64a522View commit details

  Copy full SHA for a64a522

  Browse repository at this point

Commits on Oct 31, 2023

• Optionally logging reference response (#847)

  Show description for 5b32372
  

  vwxyzjn

  and

  younesbelkada

  authored
  5b32372View commit details

  Copy full SHA for 5b32372

  Browse repository at this point

• Fix stale bot (#935)

  Show description for d759004
  younesbelkada

  authored
  d759004View commit details

  Copy full SHA for d759004

  Browse repository at this point

• [`core` / `DDP`] Fix RM trainer + DDP + quantization + propagate `gradient_checkpointing_kwargs` in SFT & DPO (#912)

  Show description for cbc6c9b
  younesbelkada

  authored
  cbc6c9bView commit details

  Copy full SHA for cbc6c9b

  Browse repository at this point

• Update dpo_llama2.py (#934)

  younesbelkada

  authored
  f3cd865View commit details

  Copy full SHA for f3cd865

  Browse repository at this point

• [`SFTTrainer`] Make sure to not conflict between `transformers` and TRL implementation (#933)

  Show description for b763432
  younesbelkada

  authored
  b763432View commit details

  Copy full SHA for b763432

  Browse repository at this point

• hotfix for dpo trainer (#919)

  Show description for 2bbd594
  mnoukhov

  authored
  2bbd594View commit details

  Copy full SHA for 2bbd594

  Browse repository at this point

• fix DPO + GC issues (#927)

  younesbelkada

  authored
  b89b712View commit details

  Copy full SHA for b89b712

  Browse repository at this point

• [Feature] Enable Intel XPU support (#839)

  Show description for ec9e766
  

  6 peopleauthored
  ec9e766View commit details

  Copy full SHA for ec9e766

  Browse repository at this point

• Bump `tyro` (#928)

  brentyi

  authored
  d192244View commit details

  Copy full SHA for d192244

  Browse repository at this point

Commits on Oct 30, 2023

• updating PPOTrainer docstring (#897)

  Show description for 051d5a1
  

  3 peopleauthored
  051d5a1View commit details

  Copy full SHA for 051d5a1

  Browse repository at this point

• Generalize NEFTune for FSDP, DDP, ... (#924)

  Show description for 2068fdc
  younesbelkada

  authored
  2068fdcView commit details

  Copy full SHA for 2068fdc

  Browse repository at this point

Commits on Oct 25, 2023

• fix stackllama2 sft gradient checkpointing (#906)

  Show description for 02f5c1d
  nrailg

  authored
  02f5c1dView commit details

  Copy full SHA for 02f5c1d

  Browse repository at this point

Commits on Oct 24, 2023

• deactivate MacOS CI (#913)

  lvwerra

  authored
  7de7db6View commit details

  Copy full SHA for 7de7db6

  Browse repository at this point

• [Update reward_trainer.py] append PeftSavingCallback if callbacks is not None (#910)

  zuoxingdong

  authored
  4e7d5b5View commit details

  Copy full SHA for 4e7d5b5

  Browse repository at this point

• Fix broken link/markdown (#903)

  Show description for a90e133
  

  osanseviero

  and

  vwxyzjn

  authored
  a90e133View commit details

  Copy full SHA for a90e133

  Browse repository at this point

• [`NEFTune`] Make use of forward hooks instead (#889)

  Show description for 5b2aeca
  younesbelkada

  authored
  5b2aecaView commit details

  Copy full SHA for 5b2aeca

  Browse repository at this point

Commits on Oct 23, 2023

• Add whiten ops before compute advatanges (#887)

  Show description for 1f3314f
  

  SingL3

  and

  Lin Junpeng

  authored
  1f3314fView commit details

  Copy full SHA for 1f3314f

  Browse repository at this point

• Fix couple broken links on lib homepage (#908)

  paulbricman

  authored
  304ee70View commit details

  Copy full SHA for 304ee70

  Browse repository at this point

Commits on Oct 19, 2023

• [reward_modeling] Cleaning example script (#882)

  Show description for 0a5aee7
  gaetanlop

  authored
  0a5aee7View commit details

  Copy full SHA for 0a5aee7

  Browse repository at this point

• fix: remove useless token (#896)

  rtrompier

  authored
  db592a2View commit details

  Copy full SHA for db592a2

  Browse repository at this point

Commits on Oct 18, 2023

• fix peft_config type (#883)

  Show description for 122edc8
  

  u2takey

  and

  wanglei.w

  authored
  122edc8View commit details

  Copy full SHA for 122edc8

  Browse repository at this point

• remove duplicate key in `reward_modeling.py` (#890)

  vwxyzjn

  authored
  f91fb2bView commit details

  Copy full SHA for f91fb2b

  Browse repository at this point

Commits on Oct 17, 2023

• fix syntax error

  graniet

  committed
  01e4ad0View commit details

  Copy full SHA for 01e4ad0

  Browse repository at this point

• Fix security breach

  rtrompier

  authored
  1e56ff0View commit details

  Copy full SHA for 1e56ff0

  Browse repository at this point

• [`SFTTrainer`] Adds NEFTune into `SFTTrainer` (#871)

  Show description for c4ed327
  

  younesbelkada

  and

  lewtun

  authored
  c4ed327View commit details

  Copy full SHA for c4ed327

  Browse repository at this point

Commits on Oct 16, 2023

• [DPO] add SLiC hinge loss to DPOTrainer (#866)

  Show description for 14b6bc6
  

  kashif

  and

  lvwerra

  authored
  14b6bc6View commit details

  Copy full SHA for 14b6bc6

  Browse repository at this point

Commits on Oct 12, 2023

• set dev version (#864)

  younesbelkada

  authored
  eb4d2f3View commit details

  Copy full SHA for eb4d2f3

  Browse repository at this point