Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on May 24, 2023

• [`core`] Add 4bit QLora (#383)

  Show description for 5fb5af7
  younesbelkada

  authored
  5fb5af7View commit details

  Copy full SHA for 5fb5af7

  Browse repository at this point

Commits on May 18, 2023

• fix warning issue (#377)

  younesbelkada

  authored
  25fa1bdView commit details

  Copy full SHA for 25fa1bd

  Browse repository at this point

Commits on May 15, 2023

• [`docs`] fix SFT doc (#367)

  Show description for 6916e0d
  younesbelkada

  authored
  6916e0dView commit details

  Copy full SHA for 6916e0d

  Browse repository at this point

• Delete test_training.py (#371)

  younesbelkada

  authored
  1704a86View commit details

  Copy full SHA for 1704a86

  Browse repository at this point

• Remove obsolete layer_norm_names parameter and add peft>=0.3.0 to requirements (#366)

  Show description for e547c39
  teticio

  authored
  e547c39View commit details

  Copy full SHA for e547c39

  Browse repository at this point

• add is_trainable in kwargs (#363)

  Show description for a31bad8
  Opdoop

  authored
  a31bad8View commit details

  Copy full SHA for a31bad8

  Browse repository at this point

Commits on May 11, 2023

• Fix bug when loading local peft model (#342)

  Show description for 31cc361
  Opdoop

  authored
  31cc361View commit details

  Copy full SHA for 31cc361

  Browse repository at this point

• 140/best n sampling (#326)

  Show description for ab453ec
  metric-space

  authored
  ab453ecView commit details

  Copy full SHA for ab453ec

  Browse repository at this point

• fix tensorboard issue (#330)

  younesbelkada

  authored
  933c91cView commit details

  Copy full SHA for 933c91c

  Browse repository at this point

• relax negative KL constraint (#352)

  younesbelkada

  authored
  ffad0a1View commit details

  Copy full SHA for ffad0a1

  Browse repository at this point

• add parameter to control max_length (to mitigate OOM errors) (#359)

  teticio

  authored
  e0172fcView commit details

  Copy full SHA for e0172fc

  Browse repository at this point

• stack_llama: update instructions in README, fix broken _get_submodules and save tokenizer (#358)

  Show description for dec9993
  teticio

  authored
  dec9993View commit details

  Copy full SHA for dec9993

  Browse repository at this point

Commits on May 4, 2023

• Fix argument's description (#339)

  vinhkhuc

  authored
  c85cdbdView commit details

  Copy full SHA for c85cdbd

  Browse repository at this point

Commits on May 3, 2023

• fix sft issues (#336)

  younesbelkada

  authored
  e59cce9View commit details

  Copy full SHA for e59cce9

  Browse repository at this point

• [`core`] officially support SFT (Supervised Finetuning) (#323)

  Show description for c60fd91
  

  3 peopleauthored
  c60fd91View commit details

  Copy full SHA for c60fd91

  Browse repository at this point

Commits on Apr 28, 2023

• added doc for using torch.distributed.launch/run (#324)

  Show description for 08f5506
  

  3 peopleauthored
  08f5506View commit details

  Copy full SHA for 08f5506

  Browse repository at this point

Commits on Apr 26, 2023

• Give a key to the wandb PPOConfig config entry (#315)

  Show description for 52fecee
  JulesGM

  authored
  52feceeView commit details

  Copy full SHA for 52fecee

  Browse repository at this point

• [`core`] Officially Support Reward Modeling (#303)

  Show description for 3cfe194
  

  3 peopleauthored
  3cfe194View commit details

  Copy full SHA for 3cfe194

  Browse repository at this point

• add details on multi-GPU / multi-node (#320)

  younesbelkada

  authored
  ad32515View commit details

  Copy full SHA for ad32515

  Browse repository at this point

Commits on Apr 25, 2023

• fix broken tests (#318)

  younesbelkada

  authored
  1f29725View commit details

  Copy full SHA for 1f29725

  Browse repository at this point

• fix DS for peft ref_model in ppo trainer (#309)

  Show description for 23a06c9
  halfrot

  authored
  23a06c9View commit details

  Copy full SHA for 23a06c9

  Browse repository at this point

• fixed typo (#312)

  soerenarlt

  authored
  5c24d5bView commit details

  Copy full SHA for 5c24d5b

  Browse repository at this point

• clean examples folder (#294)

  Show description for 503ac5d
  

  Nathan Lambert

  authored
  503ac5dView commit details

  Copy full SHA for 503ac5d

  Browse repository at this point

Commits on Apr 17, 2023

• Log Token distribution of Query / Response (#295)

  Show description for ce37ead
  

  Nathan Lambert

  authored
  ce37eadView commit details

  Copy full SHA for ce37ead

  Browse repository at this point

Commits on Apr 14, 2023

• [`t5`] Fix negative kl issue (#262)

  Show description for 160d0c9
  younesbelkada

  authored
  160d0c9View commit details

  Copy full SHA for 160d0c9

  Browse repository at this point

Commits on Apr 12, 2023

• Fix arguments description (#298)

  Show description for d1c7529
  lvzii

  authored
  d1c7529View commit details

  Copy full SHA for d1c7529

  Browse repository at this point

Commits on Apr 10, 2023

• Small improvements / fixes to toxicity example (#266)

  Show description for fc468e0
  

  Nathan Lambert

  and

  younesbelkada

  authored
  fc468e0View commit details

  Copy full SHA for fc468e0

  Browse repository at this point

• add functionality to push best models to the hub during training (#275)

  Show description for 131e5cd
  

  3 peopleauthored
  131e5cdView commit details

  Copy full SHA for 131e5cd

  Browse repository at this point

• fix typo in gpt2-sentiment.ipynb (#293)

  Show description for bb4a980
  eltociear

  authored
  bb4a980View commit details

  Copy full SHA for bb4a980

  Browse repository at this point

• Fix swapped helper texts (#284)

  philipp-classen

  authored
  3804a72View commit details

  Copy full SHA for 3804a72

  Browse repository at this point

Commits on Apr 7, 2023

• Add LLaMA tutorial to docs (#278)

  Show description for a004b02
  

  Nathan Lambert

  authored
  a004b02View commit details

  Copy full SHA for a004b02

  Browse repository at this point

• fix doc string problem in ppo trainer loss function (#279)

  Show description for 8b23447
  thuwyh

  authored
  8b23447View commit details

  Copy full SHA for 8b23447

  Browse repository at this point

Commits on Apr 6, 2023

• Adding pointer back to Meta's LLaMA. (#277)

  meg-huggingface

  authored
  cf20878View commit details

  Copy full SHA for cf20878

  Browse repository at this point

Commits on Apr 5, 2023

• stack-llama (#273)

  Show description for d8ae4d0
  

  edbeeching

  and

  lvwerra

  authored
  d8ae4d0View commit details

  Copy full SHA for d8ae4d0

  Browse repository at this point

Commits on Apr 3, 2023

• Use active model to generate response in example on README (#269) (#271)

  Show description for a2749d9
  

  rmill040

  and

  rmilleti-aws

  authored
  a2749d9View commit details

  Copy full SHA for a2749d9

  Browse repository at this point