Commits

Branch selector

main

User selector

edbeeching

Datepicker

All time

Commit history

Commits on May 6, 2025

• 🎲 [GRPO] Shuffle mini batches (#3391)

  Show description for adfa7fd
  

  3 peopleauthored
  adfa7fdView commit details

  Copy full SHA for adfa7fd

  Browse repository at this point

• 💔 [GRPO] Decouple gradient accumulation from the number of minibatches generated (#3388)

  Show description for cf5183d
  

  edbeeching

  and

  qgallouedec

  authored
  cf5183dView commit details

  Copy full SHA for cf5183d

  Browse repository at this point

Commits on Apr 9, 2025

• 👎 [GRPO] Adds option to disable dropout (#3234)

  Show description for 47b9515
  

  edbeeching

  and

  qgallouedec

  authored
  47b9515View commit details

  Copy full SHA for 47b9515

  Browse repository at this point

Commits on Apr 1, 2025

• [GRPO] Improve completion length logging (#3188)

  edbeeching

  authored
  9f3702fView commit details

  Copy full SHA for 9f3702f

  Browse repository at this point

Commits on Feb 27, 2025

• 🪪 Adds a more fine-grained profiling context (#2975)

  Show description for ac327d5
  

  edbeeching

  and

  qgallouedec

  authored
  ac327d5View commit details

  Copy full SHA for ac327d5

  Browse repository at this point

Commits on Feb 20, 2025

• 🪪 Adds profiling decorators for GRPOTrainer (#2889)

  Show description for a92e00e
  

  edbeeching

  and

  qgallouedec

  authored
  a92e00eView commit details

  Copy full SHA for a92e00e

  Browse repository at this point

Commits on Feb 18, 2025

• Optimize vllm num_generations (#2855)

  Show description for 963243a
  edbeeching

  authored
  963243aView commit details

  Copy full SHA for 963243a

  Browse repository at this point

Commits on Feb 17, 2025

• [GRPO] Fix loss normalization (#2881)

  Show description for 293b620
  edbeeching

  authored
  293b620View commit details

  Copy full SHA for 293b620

  Browse repository at this point

• 🆙 Bump vLLM min version to 0.7.2 (#2860)

  Show description for ae3bd0d
  edbeeching

  authored
  ae3bd0dView commit details

  Copy full SHA for ae3bd0d

  Browse repository at this point

Commits on Feb 13, 2025

• Fix PeftModel check when moving weights to vlllm (#2850)

  Show description for b0f513c
  edbeeching

  authored
  b0f513cView commit details

  Copy full SHA for b0f513c

  Browse repository at this point

Commits on Sep 25, 2024

• Generalizes VSFT script to support REDACTED (#2120)

  Show description for 7a24565
  

  edbeeching

  and

  kashif

  authored
  7a24565View commit details

  Copy full SHA for 7a24565

  Browse repository at this point

Commits on Aug 29, 2024

• Adds experimental Liger support to SFT script (#1992)

  Show description for 4dd0dc2
  

  edbeeching

  and

  lewtun

  authored
  4dd0dc2View commit details

  Copy full SHA for 4dd0dc2

  Browse repository at this point

Commits on Jul 26, 2024

• fix online dpo example (#1879)

  edbeeching

  authored
  74e54b5View commit details

  Copy full SHA for 74e54b5

  Browse repository at this point

Commits on Apr 12, 2024

• VSFT hotfix - adds gen prompt to template and processor to hub (#1532)

  Show description for 1c0d8bc
  edbeeching

  authored
  1c0d8bcView commit details

  Copy full SHA for 1c0d8bc

  Browse repository at this point

Commits on Apr 11, 2024

• Adds VLM Training support to SFTTrainer + VSFT script (#1518)

  Show description for 346c99d
  

  edbeeching

  and

  younesbelkada

  authored
  346c99dView commit details

  Copy full SHA for 346c99d

  Browse repository at this point

Commits on Nov 30, 2023

• Fixes reward and text gathering in distributed training (#850)

  Show description for 481ef96
  

  3 peopleauthored
  481ef96View commit details

  Copy full SHA for 481ef96

  Browse repository at this point

Commits on Nov 6, 2023

• Adds model kwargs to SFT and DPO trainers (#951)

  Show description for c273b18
  edbeeching

  authored
  c273b18View commit details

  Copy full SHA for c273b18

  Browse repository at this point

Commits on Jul 27, 2023

• Computes the KL penalty using the entire distribution (#541)

  Show description for 31658b4
  edbeeching

  authored
  31658b4View commit details

  Copy full SHA for 31658b4

  Browse repository at this point

Commits on Jul 5, 2023

• Adds some options to stabilize the KL penalty (#486)

  Show description for 2b531b9
  

  3 peopleauthored
  2b531b9View commit details

  Copy full SHA for 2b531b9

  Browse repository at this point

Commits on Apr 5, 2023

• stack-llama (#273)

  Show description for d8ae4d0
  

  edbeeching

  and

  lvwerra

  authored
  d8ae4d0View commit details

  Copy full SHA for d8ae4d0

  Browse repository at this point

Commits on Mar 23, 2023

• adds early stopping (#238)

  Show description for 1620da3
  edbeeching

  authored
  1620da3View commit details

  Copy full SHA for 1620da3

  Browse repository at this point

Commits on Mar 16, 2023

• adds a missing detach to the ratio (#224)

  Show description for 90f0090
  edbeeching

  authored
  90f0090View commit details

  Copy full SHA for 90f0090

  Browse repository at this point

• Grad accumulation and memory bugfix (#220)

  Show description for 768c389
  edbeeching

  authored
  768c389View commit details

  Copy full SHA for 768c389

  Browse repository at this point

Commits on Mar 9, 2023

• adds sentiment example for a 20b model (#208)

  Show description for ddb6df3
  

  edbeeching

  and

  younesbelkada

  authored
  ddb6df3View commit details

  Copy full SHA for ddb6df3

  Browse repository at this point

Commits on Mar 7, 2023

• `peft` integration (#163)

  Show description for 679f29d
  

  edbeeching

  and

  younesbelkada

  authored
  679f29dView commit details

  Copy full SHA for 679f29d

  Browse repository at this point

Commits on Jan 25, 2023

• Convert notebook 05 (#80)

  Show description for 6b37618
  

  edbeeching

  and

  leandro

  authored
  6b37618View commit details

  Copy full SHA for 6b37618

  Browse repository at this point

Commits on Jan 5, 2023

• Merge pull request #70 from lvwerra/improvements-1a

  Show description for 7eba287
  edbeeching

  authored
  7eba287View commit details

  Copy full SHA for 7eba287

  Browse repository at this point

Commits on Jan 4, 2023

• make quality

  edbeeching

  committed
  74a650dView commit details

  Copy full SHA for 74a650d

  Browse repository at this point

• updates based on feedback to PR

  edbeeching

  committed
  e9ddf0dView commit details

  Copy full SHA for e9ddf0d

  Browse repository at this point

• fixed isort issue

  edbeeching

  committed
  db2fb06View commit details

  Copy full SHA for db2fb06

  Browse repository at this point

• more fixing isort

  edbeeching

  committed
  e30cd46View commit details

  Copy full SHA for e30cd46

  Browse repository at this point

• still debugging isort

  edbeeching

  committed
  f3c9ab6View commit details

  Copy full SHA for f3c9ab6

  Browse repository at this point

• debugging isort issue

  edbeeching

  committed
  c047e11View commit details

  Copy full SHA for c047e11

  Browse repository at this point

• updates gitignore for wandb files

  edbeeching

  committed
  9ff1510View commit details

  Copy full SHA for 9ff1510

  Browse repository at this point

• adds accelerate as a dependency

  edbeeching

  committed
  5286000View commit details

  Copy full SHA for 5286000

  Browse repository at this point