Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jun 9, 2025

• Update vllm_serve.py

  deep-diver

  authored
  686ad38View commit details

  Copy full SHA for 686ad38

  Browse repository at this point

Commits on Jun 5, 2025

• Update vllm_serve.py

  deep-diver

  authored
  d5c24a6View commit details

  Copy full SHA for d5c24a6

  Browse repository at this point

Commits on May 14, 2025

• Update grpo_trainer.py

  deep-diver

  authored
  a940d13View commit details

  Copy full SHA for a940d13

  Browse repository at this point

Commits on May 13, 2025

• feat: Implement Two-Sided Clipping for GRPO Trainer (#3434)

  Show description for 05bc43e
  

  3 peopleauthored
  05bc43eView commit details

  Copy full SHA for 05bc43e

  Browse repository at this point

• use device agnostic empty_cache in ppo & rloo (#3439)

  Show description for d3dc8ff
  

  yao-matrix

  and

  kashif

  authored
  d3dc8ffView commit details

  Copy full SHA for d3dc8ff

  Browse repository at this point

• enable `trl env` on xpu (#3438)

  Show description for 21738c3
  

  yao-matrix

  and

  kashif

  authored
  21738c3View commit details

  Copy full SHA for 21738c3

  Browse repository at this point

Commits on May 9, 2025

• 🏹 Support kv_cache_dtype to quantize kv-cache in vllm (#3422)

  Show description for eab175d
  

  winglian

  and

  qgallouedec

  authored
  eab175dView commit details

  Copy full SHA for eab175d

  Browse repository at this point

Commits on May 8, 2025

• Update README.md

  qgallouedec

  authored
  4da4dc9View commit details

  Copy full SHA for 4da4dc9

  Browse repository at this point

• Update README.md (#3420)

  qgallouedec

  authored
  6b3a023View commit details

  Copy full SHA for 6b3a023

  Browse repository at this point

• 🧪 Testing support for Qwen3 tiny (#3415)

  shirinyamani

  authored
  abbbb93View commit details

  Copy full SHA for abbbb93

  Browse repository at this point

Commits on May 7, 2025

• [Models] Activation checkpointing from TorchTune (#2954)

  Show description for cafa663
  

  11 peopleauthored
  cafa663View commit details

  Copy full SHA for cafa663

  Browse repository at this point

• 🐍 Support Python 3.13 (#2593)

  qgallouedec

  authored
  fd04a54View commit details

  Copy full SHA for fd04a54

  Browse repository at this point

Commits on May 6, 2025

• 🎁 Reward takes completion ids (#3272)

  Show description for 56e5766
  

  3 peopleauthored
  56e5766View commit details

  Copy full SHA for 56e5766

  Browse repository at this point

• 📝 vLLM-integration documentation (#3376)

  Show description for 89d44ca
  

  shirinyamani

  and

  qgallouedec

  authored
  89d44caView commit details

  Copy full SHA for 89d44ca

  Browse repository at this point

• 🎲 [GRPO] Shuffle mini batches (#3391)

  Show description for adfa7fd
  

  3 peopleauthored
  adfa7fdView commit details

  Copy full SHA for adfa7fd

  Browse repository at this point

• 💔 [GRPO] Decouple gradient accumulation from the number of minibatches generated (#3388)

  Show description for cf5183d
  

  edbeeching

  and

  qgallouedec

  authored
  cf5183dView commit details

  Copy full SHA for cf5183d

  Browse repository at this point

• 🤝 Compatibility of the TRL CLI with accelerate arguments (#3409)

  Show description for 1954c02
  

  qgallouedec

  and

  lewtun

  authored
  1954c02View commit details

  Copy full SHA for 1954c02

  Browse repository at this point

• ✌️ Add support for FSDP2 (#3317)

  Show description for 45f4c58
  

  lewtun

  and

  qgallouedec

  authored
  45f4c58View commit details

  Copy full SHA for 45f4c58

  Browse repository at this point

Commits on May 2, 2025

• 🕊️ Un-restrict diffusers (#3407)

  qgallouedec

  authored
  cc044e3View commit details

  Copy full SHA for cc044e3

  Browse repository at this point

• 🕺 Migrate setup configuration from `setup.py` to `setup.cfg` and make `rich` an optional dep (#3403)

  Show description for 999acd5
  

  qgallouedec

  and

  lewtun

  authored
  999acd5View commit details

  Copy full SHA for 999acd5

  Browse repository at this point

• 🪪 Remove license classifier (#3402)

  qgallouedec

  authored
  8606b1aView commit details

  Copy full SHA for 8606b1a

  Browse repository at this point

• 👉 [DPO] Model forward pass padding side fix (#3307)

  Show description for a673da5
  

  LeonEricsson

  and

  qgallouedec

  authored
  a673da5View commit details

  Copy full SHA for a673da5

  Browse repository at this point

• 🦁 Fix liger initialization (#3401)

  Show description for 00b8e31
  

  shivam15s

  and

  qgallouedec

  authored
  00b8e31View commit details

  Copy full SHA for 00b8e31

  Browse repository at this point

Commits on May 1, 2025

• 💔 [SFT] Raise error when `formatting_func` is used with `completion_only_loss` (#3385)

  Show description for c163cf5
  

  LeonEricsson

  and

  qgallouedec

  authored
  c163cf5View commit details

  Copy full SHA for c163cf5

  Browse repository at this point

• ✨ [IterativeSFT] Small refresher (#3378)

  LeonEricsson

  authored
  bc9c019View commit details

  Copy full SHA for bc9c019

  Browse repository at this point

• 🧑‍🤝‍🧑 Co-Locating vLLM w/ training to for higher throughput and GPU utilization (#3394)

  Show description for 18596cf
  

  toslali-ibm

  and

  qgallouedec

  authored
  18596cfView commit details

  Copy full SHA for 18596cf

  Browse repository at this point

• 🌊 Add MLflow metrics in profiling context (#3400)

  Show description for 280d353
  

  dhruvmullick

  and

  qgallouedec

  authored
  280d353View commit details

  Copy full SHA for 280d353

  Browse repository at this point

• [GRPO] Reference model initialization bug fix (#3397)

  LeonEricsson

  authored
  13fa840View commit details

  Copy full SHA for 13fa840

  Browse repository at this point

Commits on Apr 30, 2025

• [🐯+GRPO] Support FSDP + Fix bug when using LigerGRPO with DDP (#3260)

  Show description for 09b669f
  

  5 peopleauthored
  09b669fView commit details

  Copy full SHA for 09b669f

  Browse repository at this point

Commits on Apr 29, 2025

• Deprecate `TextEnvironment` and tools (#3389)

  lewtun

  authored
  01d0be1View commit details

  Copy full SHA for 01d0be1

  Browse repository at this point

• DPO fixes for evaluations (#3377)

  winglian

  authored
  3a42af1View commit details

  Copy full SHA for 3a42af1

  Browse repository at this point

• PEFT support for Liger GRPO (#3355)

  Show description for aaf3960
  

  salmanmohammadi

  and

  kashif

  authored
  aaf3960View commit details

  Copy full SHA for aaf3960

  Browse repository at this point

Commits on Apr 28, 2025

• 📋 Allow calling trl cli in sft mode with config file (#3380)

  Show description for 2bf4847
  

  CloseChoice

  and

  qgallouedec

  authored
  2bf4847View commit details

  Copy full SHA for 2bf4847

  Browse repository at this point

Commits on Apr 26, 2025

• ⚰️ Remove deprecated (#3364)

  qgallouedec

  authored
  a8cfca6View commit details

  Copy full SHA for a8cfca6

  Browse repository at this point

• Better guards for DeepSpeed imports (#3351)

  lewtun

  authored
  1bca495View commit details

  Copy full SHA for 1bca495

  Browse repository at this point