Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Nov 12, 2024

• 👋 Remove deprecated `tokenizer` argument in BCO, GKD, Iterative SFT, Nash MD and XPO (#2349)

  qgallouedec

  authored
  6239631View commit details

  Copy full SHA for 6239631

  Browse repository at this point

• Adding video llm fine-tuning example (#2336)

  Show description for 2d24d35
  

  mfarre

  and

  kashif

  authored
  2d24d35View commit details

  Copy full SHA for 2d24d35

  Browse repository at this point

Commits on Nov 11, 2024

• 🖨️ Fix error text in BCO and KTO tokenizing function (#2286)

  PhilipMay

  authored
  dde20b2View commit details

  Copy full SHA for dde20b2

  Browse repository at this point

• 👈 Add `tokenizer` arg back and add deprecation guidelines (#2348)

  Show description for 015321e
  qgallouedec

  authored
  015321eView commit details

  Copy full SHA for 015321e

  Browse repository at this point

• 💣 Remove transformers version check (#2343)

  xyangk

  authored
  454f36dView commit details

  Copy full SHA for 454f36d

  Browse repository at this point

• 🪡 Various RLOO fixes (#2325)

  qgallouedec

  authored
  9b7f9f3View commit details

  Copy full SHA for 9b7f9f3

  Browse repository at this point

• 🫴 Better guide users in error reporting (#2327)

  Show description for 518e29c
  

  qgallouedec

  and

  kashif

  authored
  518e29cView commit details

  Copy full SHA for 518e29c

  Browse repository at this point

• 🧞 Add `output_layer` to the list of `lm_head_namings` in `AutoModelForCausalLMWithValueHead` (#2328)

  qgallouedec

  authored
  ac7b6cfView commit details

  Copy full SHA for ac7b6cf

  Browse repository at this point

Commits on Nov 10, 2024

• DPO trainer supports num_logits_to_keep to save memory (#2129)

  Show description for 0238d96
  

  xyangk

  and

  kashif

  authored
  0238d96View commit details

  Copy full SHA for 0238d96

  Browse repository at this point

Commits on Nov 8, 2024

• Bump liger-kernel to fix grad acc and more features (#2333)

  Show description for c86b51c
  

  ByronHsu

  and

  kashif

  authored
  c86b51cView commit details

  Copy full SHA for c86b51c

  Browse repository at this point

Commits on Nov 7, 2024

• Fix gradient_checkpointing_kwargs assignment in examples (#2331)

  Show description for ac77c09
  

  Galaxy-Husky

  and

  Ping

  authored
  ac77c09View commit details

  Copy full SHA for ac77c09

  Browse repository at this point

• fix truncating index in DPOTrainer's concatenated_forward() (#2332)

  yanghh2000

  authored
  7f2ccbeView commit details

  Copy full SHA for 7f2ccbe

  Browse repository at this point

Commits on Nov 4, 2024

• 🪪 Check with `token_id` instead of `token` in `DPOTrainer` (#2324)

  qgallouedec

  authored
  74e20cbView commit details

  Copy full SHA for 74e20cb

  Browse repository at this point

• 🪧 Fix slack notification titles (#2322)

  qgallouedec

  authored
  27b9e3aView commit details

  Copy full SHA for 27b9e3a

  Browse repository at this point

• 🧽 Fix judge documentation (#2320)

  Show description for dc2b8b9
  qgallouedec

  authored
  dc2b8b9View commit details

  Copy full SHA for dc2b8b9

  Browse repository at this point

• ⚰️ Remove deprecated args, script arguments, and PPOv2 (#2306)

  Show description for 5e90682
  qgallouedec

  authored
  5e90682View commit details

  Copy full SHA for 5e90682

  Browse repository at this point

• 📰 Update blog posts in documentation (#2319)

  Show description for 3b43996
  qgallouedec

  authored
  3b43996View commit details

  Copy full SHA for 3b43996

  Browse repository at this point

• ⏫ Bump dev version to `0.13.0.dev0` (#2305)

  Show description for 2f34a16
  qgallouedec

  authored
  2f34a16View commit details

  Copy full SHA for 2f34a16

  Browse repository at this point

Commits on Oct 31, 2024

• 🧓 Specify and test min versions (#2303)

  Show description for 6138439
  qgallouedec

  authored
  6138439View commit details

  Copy full SHA for 6138439

  Browse repository at this point

• 🧩 Add `optimizer_cls_and_kwargs` attribute to `PPOTrainer` and `RLOOTrainer` (#2302)

  qgallouedec

  authored
  d57a181View commit details

  Copy full SHA for d57a181

  Browse repository at this point

• 🙅 Ensure dependency optionality (#2301)

  Show description for 73c3970
  qgallouedec

  authored
  73c3970View commit details

  Copy full SHA for 73c3970

  Browse repository at this point

• ⌛ Remove stale bot (#2300)

  qgallouedec

  authored
  013a32bView commit details

  Copy full SHA for 013a32b

  Browse repository at this point

• 🔧 Use standard unittest assertion methods (#2283)

  Show description for 24fb327
  

  ccs96307

  and

  qgallouedec

  authored
  24fb327View commit details

  Copy full SHA for 24fb327

  Browse repository at this point

• 💾 Fix `_save_checkpoint` for online methods (#2288)

  Show description for bb56c6e
  qgallouedec

  authored
  bb56c6eView commit details

  Copy full SHA for bb56c6e

  Browse repository at this point

• 🖇️ Better dependency and partitioning of CI tests (#2298)

  Show description for 06be6f4
  qgallouedec

  authored
  06be6f4View commit details

  Copy full SHA for 06be6f4

  Browse repository at this point

Commits on Oct 28, 2024

• 🍬 Use any reward model for online methods (#2276)

  Show description for b269657
  qgallouedec

  authored
  b269657View commit details

  Copy full SHA for b269657

  Browse repository at this point

• 🔌 Fix type hint in `LogCompletionsCallback` (#2285)

  Show description for 0ce3b65
  

  anch0vy

  and

  qgallouedec

  authored
  0ce3b65View commit details

  Copy full SHA for 0ce3b65

  Browse repository at this point

• ⛓️‍💥 Don't use `eval_dataset` in scripts when no eval strategy (#2270)

  qgallouedec

  authored
  e155cb8View commit details

  Copy full SHA for e155cb8

  Browse repository at this point

Commits on Oct 25, 2024

• 🧮 Fix the computation of KL divergence loss (#2277)

  

  Daniil Tiapkin

  authored
  ea7a1beView commit details

  Copy full SHA for ea7a1be

  Browse repository at this point

• 🏁 Add `bos_token_id` only if it exists (#2279)

  Show description for 110d088
  

  seanexp

  and

  sean.jung

  authored
  110d088View commit details

  Copy full SHA for 110d088

  Browse repository at this point

Commits on Oct 24, 2024

• 🧘 Replace `F.log(F.sigmoid(log_odds)` with `F.logsigmoid(log_odds)` (#2274)

  Show description for 57ba9b9
  

  zhanwenchen

  and

  qgallouedec

  authored
  57ba9b9View commit details

  Copy full SHA for 57ba9b9

  Browse repository at this point

• 🧼 Refactor `log_reports.py` for Improved Logging, File Processing, and Slack Payload Handling (#2249)

  Show description for 0de75b2
  

  Mefisto04

  and

  qgallouedec

  authored
  0de75b2View commit details

  Copy full SHA for 0de75b2

  Browse repository at this point

• ♾️ Fix test generation `max_new_tokens` (#2272)

  Show description for e615974
  qgallouedec

  authored
  e615974View commit details

  Copy full SHA for e615974

  Browse repository at this point

• Add `torch_dtype` to model kwargs in reward modeling example (#2266)

  Show description for c2bb1ee
  

  cameronphchen

  and

  qgallouedec

  authored
  c2bb1eeView commit details

  Copy full SHA for c2bb1ee

  Browse repository at this point

• [Judges] use the pair-judges in online-preference trainers (#2243)

  Show description for 9c376c5
  

  kashif

  and

  qgallouedec

  authored
  9c376c5View commit details

  Copy full SHA for 9c376c5

  Browse repository at this point