Commits

Branch selector

main

User selector

kashif

All time

Commit history

Commits on Feb 18, 2025

• 📍 [GRPO] add gradient_checkpointing (#2848)

  Show description for 9b3c5bf
  

  kashif

  and

  qgallouedec

  authored
  9b3c5bfView commit details

  Copy full SHA for 9b3c5bf

  Browse repository at this point

Commits on Feb 17, 2025

• 💬 Add `maybe_convert_to_chatml` map for conversational datasets in SFT (#2862)

  Show description for ba03657
  

  kashif

  and

  qgallouedec

  authored
  ba03657View commit details

  Copy full SHA for ba03657

  Browse repository at this point

• [SFT] fix check for AutoLigerKernelForCausalLM (#2874)

  Show description for 6d9fc11
  kashif

  authored
  6d9fc11View commit details

  Copy full SHA for 6d9fc11

  Browse repository at this point

Commits on Feb 7, 2025

• 🎯 [SFT] add token accuracy metric (#2597)

  Show description for 84d73fd
  

  kashif

  and

  qgallouedec

  authored
  84d73fdView commit details

  Copy full SHA for 84d73fd

  Browse repository at this point

Commits on Jan 30, 2025

• 📋 Add eval loss logging during prediction in GRPO (#2694)

  Show description for fecaa99
  

  kashif

  and

  qgallouedec

  authored
  fecaa99View commit details

  Copy full SHA for fecaa99

  Browse repository at this point

Commits on Jan 17, 2025

• [RLOO] fix token_level_kl (#2575)

  Show description for 1b1140a
  kashif

  authored
  1b1140aView commit details

  Copy full SHA for 1b1140a

  Browse repository at this point

Commits on Jan 9, 2025

• [RLOO] Reinforce++ (#2552)

  Show description for edabe0a
  kashif

  authored
  edabe0aView commit details

  Copy full SHA for edabe0a

  Browse repository at this point

Commits on Jan 8, 2025

• ↩️ Revert ORPO loss changes (#2527)

  Show description for beb892b
  kashif

  authored
  beb892bView commit details

  Copy full SHA for beb892b

  Browse repository at this point

Commits on Dec 19, 2024

• fix orpo chosen-nll loss (#2502)

  kashif

  authored
  88ad1a0View commit details

  Copy full SHA for 88ad1a0

  Browse repository at this point

Commits on Dec 12, 2024

• 🛠️ Update tests and fix PPO (#2463)

  Show description for efc687d
  

  3 peopleauthored
  efc687dView commit details

  Copy full SHA for efc687d

  Browse repository at this point

Commits on Nov 26, 2024

• 🐢 Fix slow tests (#2397)

  Show description for 9368dcc
  

  kashif

  and

  qgallouedec

  authored
  9368dccView commit details

  Copy full SHA for 9368dcc

  Browse repository at this point

Commits on Nov 20, 2024

• remove redunant call to eval and train (#2372)

  kashif

  authored
  bb0afc2View commit details

  Copy full SHA for bb0afc2

  Browse repository at this point

Commits on Nov 18, 2024

• 🔮 Inference mode in `GeometricMixtureWrapper.forward` (#2345)

  Show description for 21d5baf
  kashif

  authored
  21d5bafView commit details

  Copy full SHA for 21d5baf

  Browse repository at this point

Commits on Nov 15, 2024

• ⚖️ Add `use_soft_judge` option to `WinRateCallback` (#2347)

  Show description for b8c9d9c
  

  kashif

  and

  qgallouedec

  authored
  b8c9d9cView commit details

  Copy full SHA for b8c9d9c

  Browse repository at this point

Commits on Oct 24, 2024

• [Judges] use the pair-judges in online-preference trainers (#2243)

  Show description for 9c376c5
  

  kashif

  and

  qgallouedec

  authored
  9c376c5View commit details

  Copy full SHA for 9c376c5

  Browse repository at this point

Commits on Oct 11, 2024

• [Judges] Soft judges for PairRM (#2221)

  Show description for cd1aa6b
  kashif

  authored
  cd1aa6bView commit details

  Copy full SHA for cd1aa6b

  Browse repository at this point

Commits on Oct 9, 2024

• [GKD] interpolate in prob. space (#2204)

  Show description for 7e5924d
  kashif

  authored
  7e5924dView commit details

  Copy full SHA for 7e5924d

  Browse repository at this point

Commits on Oct 7, 2024

• [CI] fix dpo gpu ci tests (#2189)

  Show description for 51ca76b
  kashif

  authored
  51ca76bView commit details

  Copy full SHA for 51ca76b

  Browse repository at this point

Commits on Sep 25, 2024

• Update example_overview.md (#2125)

  kashif

  authored
  b5e4bc5View commit details

  Copy full SHA for b5e4bc5

  Browse repository at this point

Commits on Sep 24, 2024

• [online-dpo] allow parse-args as list of floats (#2108)

  Show description for 80038a5
  

  kashif

  and

  qgallouedec

  authored
  80038a5View commit details

  Copy full SHA for 80038a5

  Browse repository at this point

• fix formatting (#2109)

  Show description for cece86b
  kashif

  authored
  cece86bView commit details

  Copy full SHA for cece86b

  Browse repository at this point

Commits on Sep 19, 2024

• [SFT] fix neftune_noise_alpha in SFTTrainer (#1841)

  Show description for 9fb871f
  

  3 peopleauthored
  9fb871fView commit details

  Copy full SHA for 9fb871f

  Browse repository at this point

Commits on Sep 16, 2024

• Nash md (#1853)

  Show description for dc2bd07
  

  4 peopleauthored
  dc2bd07View commit details

  Copy full SHA for dc2bd07

  Browse repository at this point

• [KTO] Overrides default `learning_rate` in `KTOConfig` (#2070)

  Show description for cdafc93
  

  kashif

  and

  qgallouedec

  authored
  cdafc93View commit details

  Copy full SHA for cdafc93

  Browse repository at this point

Commits on Sep 14, 2024

• remove min_new_tokens=args.max_new_tokens (#2069)

  kashif

  authored
  f6c6643View commit details

  Copy full SHA for f6c6643

  Browse repository at this point

Commits on Sep 11, 2024

• Gkd trainer (#1814)

  Show description for 85696aa
  

  3 peopleauthored
  85696aaView commit details

  Copy full SHA for 85696aa

  Browse repository at this point

Commits on Sep 10, 2024

• [XPO] xpo trainer (#1943)

  Show description for 3511856
  

  kashif

  and

  qgallouedec

  authored
  3511856View commit details

  Copy full SHA for 3511856

  Browse repository at this point

Commits on Sep 3, 2024

• [ci] pin numpy to < 2 on win (#2009)

  kashif

  authored
  d60a1f5View commit details

  Copy full SHA for d60a1f5

  Browse repository at this point

Commits on Sep 2, 2024

• [pre-commit] update pre-commit yaml (#2002)

  Show description for 850ddcf
  kashif

  authored
  850ddcfView commit details

  Copy full SHA for 850ddcf

  Browse repository at this point

Commits on Aug 30, 2024

• [Online-DPO] fixes to the training scripts and setup.py (#1997)

  Show description for d57e4b7
  kashif

  authored
  d57e4b7View commit details

  Copy full SHA for d57e4b7

  Browse repository at this point

Commits on Aug 28, 2024

• [DPO] tokenize and process DPO data via batches (#1914)

  Show description for 47ab034
  

  3 peopleauthored
  47ab034View commit details

  Copy full SHA for 47ab034

  Browse repository at this point

• gather the target model params as well (#1978)

  kashif

  authored
  a15a80eView commit details

  Copy full SHA for a15a80e

  Browse repository at this point

Commits on Aug 6, 2024

• [Online-DPO] num_generation_per_prompt is fixed (#1898)

  Show description for fc76fe8
  kashif

  authored
  fc76fe8View commit details

  Copy full SHA for fc76fe8

  Browse repository at this point

• [RPO] use loss from v3 of paper (#1904)

  Show description for 6faf4c0
  

  kashif

  and

  qgallouedec

  authored
  6faf4c0View commit details

  Copy full SHA for 6faf4c0

  Browse repository at this point

Commits on Jul 24, 2024

• [online-DPO] online dpo cleanups (#1864)

  Show description for 7dcf437
  kashif

  authored
  7dcf437View commit details

  Copy full SHA for 7dcf437

  Browse repository at this point