Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Jun 5, 2026

• Fix backbone access in GRPO by aligning with SFT (#5949)

  albertvillanova

  authored
  b98dd9fView commit details

  Copy full SHA for b98dd9f

  Browse repository at this point

• Fix: Route liger student forward through DDP wrapper in GKD, GOLD, and Distillation trainers (#5934)

  albertvillanova

  authored
  1cdf17eView commit details

  Copy full SHA for 1cdf17e

  Browse repository at this point

• Align KTO with DPO: Inline _compute_logps into _compute_loss (#5936)

  albertvillanova

  authored
  41a59f0View commit details

  Copy full SHA for 41a59f0

  Browse repository at this point

• Add experimental A2PO trainer (Optimal Advantage Regression) (#5940)

  Show description for da3ee53
  

  3 peopleauthored
  da3ee53View commit details

  Copy full SHA for da3ee53

  Browse repository at this point

• Fix SFT padding-free test config (#5923)

  kashif

  authored
  5f0e83dView commit details

  Copy full SHA for 5f0e83d

  Browse repository at this point

• Enable gradient checkpointing in Nemotron 3 SFT example (transformers>=5.7.0) (#5944)

  Show description for 29f9c29
  

  sergiopaniego

  and

  albertvillanova

  authored
  29f9c29View commit details

  Copy full SHA for 29f9c29

  Browse repository at this point

• Nemotron 3 Ultra support (#5942)

  qgallouedec

  authored
  d0b2267View commit details

  Copy full SHA for d0b2267

  Browse repository at this point

Commits on Jun 4, 2026

• NemotronH integration (#5938)

  qgallouedec

  authored
  ff0b353View commit details

  Copy full SHA for ff0b353

  Browse repository at this point

• Refresh `sft.json` / `dpo.json` snapshots after transformers `num_items_in_batch fix` (#5845)

  qgallouedec

  authored
  1fbe035View commit details

  Copy full SHA for 1fbe035

  Browse repository at this point

• docs: update OpenEnv doc URLs from meta-pytorch.org to huggingface.co/docs/openenv (#5929)

  sergiopaniego

  authored
  da39f98View commit details

  Copy full SHA for da39f98

  Browse repository at this point

Commits on Jun 3, 2026

• Remove redundant .contiguous() calls in DPOTrainer to reduce peak memory with 15% save (#5926)

  flutist

  authored
  c3f21edView commit details

  Copy full SHA for c3f21ed

  Browse repository at this point

• feat: move async rollout worker to separate process (#5749)

  AmineDiro

  authored
  8e4d5e9View commit details

  Copy full SHA for 8e4d5e9

  Browse repository at this point

• Support kernels extra for transformers < 5.1.0 (#5928)

  albertvillanova

  authored
  414483bView commit details

  Copy full SHA for 414483b

  Browse repository at this point

• docs: update OpenEnv GitHub org references and package name (#5919)

  sergiopaniego

  authored
  45ff23bView commit details

  Copy full SHA for 45ff23b

  Browse repository at this point

• chore: update docker-build.yml with version parsing (#5920)

  Show description for cb1520a
  hf-security-analysis[bot]

  authored
  cb1520aView commit details

  Copy full SHA for cb1520a

  Browse repository at this point

• Align KTO with DPO: Replace completion_labels/get_batch_logps with completion_mask (#5914)

  albertvillanova

  authored
  1bb5cebView commit details

  Copy full SHA for 1bb5ceb

  Browse repository at this point

Commits on Jun 2, 2026

• Bump the actions group with 9 updates (#5913)

  Show description for 8156dc8
  

  dependabot[bot]

  and

  qgallouedec

  authored
  8156dc8View commit details

  Copy full SHA for 8156dc8

  Browse repository at this point

• ci: use GitHub App auth for doc preview comment bot (#5915)

  sergiopaniego

  authored
  1785b42View commit details

  Copy full SHA for 1785b42

  Browse repository at this point

• Don't treat ROCm GPUs as Ampere (#5917)

  kashif

  authored
  8e47300View commit details

  Copy full SHA for 8e47300

  Browse repository at this point

• Exclude None reward completions from GRPO/RLOO advantage baseline (#5902)

  AmineDiro

  authored
  1c7c7f9View commit details

  Copy full SHA for 1c7c7f9

  Browse repository at this point

• chore: enable Dependabot weekly GitHub Actions bumps (#5910)

  Show description for fb135f2
  hf-dependantbot-rollout[bot]

  authored
  fb135f2View commit details

  Copy full SHA for fb135f2

  Browse repository at this point

• Fix `loss_type="chunked_nll"` under DeepSpeed ZeRO-3 (#5873)

  qgallouedec

  authored
  c207b9fView commit details

  Copy full SHA for c207b9f

  Browse repository at this point

• Fix priority order in PPO ValueHead and raise ValueError for unsupported config (#5908)

  albertvillanova

  authored
  4e25fc8View commit details

  Copy full SHA for 4e25fc8

  Browse repository at this point

• Support multimodal config in PPO ValueHead (#5907)

  albertvillanova

  authored
  85ab152View commit details

  Copy full SHA for 85ab152

  Browse repository at this point

• Align KTO with DPO: Use datasets caching in precompute_ref_logps (#5909)

  albertvillanova

  authored
  527392dView commit details

  Copy full SHA for 527392d

  Browse repository at this point

• [1/2] refactor: decoupled self distillation trainers (sdpo, sdft, ...) (#5862)

  Show description for 50debe8
  

  3 peopleauthored
  50debe8View commit details

  Copy full SHA for 50debe8

  Browse repository at this point

• Replace custom numpy cache in precompute_ref_logps with native datasets (#5906)

  albertvillanova

  authored
  41d2363View commit details

  Copy full SHA for 41d2363

  Browse repository at this point

• Fix GRPO use_liger_kernel under DeepSpeed ZeRO-3 (#5891)

  kashif

  authored
  f298ae3View commit details

  Copy full SHA for f298ae3

  Browse repository at this point

Commits on Jun 1, 2026

• Align KTO with DPO: Decouple KL dataset generation (#5899)

  albertvillanova

  authored
  56cbcdaView commit details

  Copy full SHA for 56cbcda

  Browse repository at this point

• Align KTO with DPO: Add activation offloading support (#5901)

  albertvillanova

  authored
  dfb489cView commit details

  Copy full SHA for dfb489c

  Browse repository at this point

• Align KTO with DPO: Add disable_gradient_checkpointing to ref model forward passes (#5900)

  albertvillanova

  authored
  882e731View commit details

  Copy full SHA for 882e731

  Browse repository at this point

• SFTTrainer: merge entropy and accuracy computation to eliminate redundant logits copy (#5897)

  Show description for 9219361
  

  flutist

  and

  qgallouedec

  authored
  9219361View commit details

  Copy full SHA for 9219361

  Browse repository at this point

Commits on May 31, 2026

• Support non-lm_head output projections in chunked SFT loss (GPTNeoX) (#5857)

  qgallouedec

  authored
  bf80d70View commit details

  Copy full SHA for bf80d70

  Browse repository at this point

Commits on May 30, 2026

• Set kernels optional dependency via transformers (#5884)

  albertvillanova

  authored
  2fc06c8View commit details

  Copy full SHA for 2fc06c8

  Browse repository at this point

Commits on May 29, 2026

• Update vLLM version support to 0.19.0 (#5879)

  sergiopaniego

  authored
  e8389e5View commit details

  Copy full SHA for e8389e5

  Browse repository at this point