Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Aug 26, 2024

• Merge branch 'main' into main

  qgallouedec

  authored
  45620ccView commit details

  Copy full SHA for 45620cc

  Browse repository at this point

• Fix issue template path (#1973)

  Show description for 2fbc0f4
  qgallouedec

  authored
  2fbc0f4View commit details

  Copy full SHA for 2fbc0f4

  Browse repository at this point

• New mismatch pair creation strategy (#1970)

  Show description for cf5168e
  qgallouedec

  authored
  cf5168eView commit details

  Copy full SHA for cf5168e

  Browse repository at this point

• Fix issue with unnecessary cached during logp calc. (#1969)

  SeungyounShin

  authored
  1e4fb80View commit details

  Copy full SHA for 1e4fb80

  Browse repository at this point

• add arg `padding_free` to DataCollatorForCompletionOnlyLM (#1887)

  Show description for fe41acd
  

  4 peopleauthored
  fe41acdView commit details

  Copy full SHA for fe41acd

  Browse repository at this point

Commits on Aug 25, 2024

• Fix issue with precompute_ref_log_probs not working when rpo_alpha is None (#1961)

  Show description for c71262c
  

  mina-parham

  and

  kashif

  authored
  c71262cView commit details

  Copy full SHA for c71262c

  Browse repository at this point

Commits on Aug 23, 2024

• Add issue/PR templates, code of conduct & better contributing guide (#1963)

  Show description for dcee683
  

  lewtun

  and

  qgallouedec

  authored
  dcee683View commit details

  Copy full SHA for dcee683

  Browse repository at this point

• Support LLaVA-NeXT in Vision SFT (#1959)

  Show description for 4788e5c
  qgallouedec

  authored
  4788e5cView commit details

  Copy full SHA for 4788e5c

  Browse repository at this point

Commits on Aug 22, 2024

• [ODPO] Refactor training script to use messages API (#1958)

  Show description for 6cea2ef
  lewtun

  authored
  6cea2efView commit details

  Copy full SHA for 6cea2ef

  Browse repository at this point

• Fix response truncation in examples/notebooks/gpt2-sentiment.ipynb (#1957)

  qgallouedec

  authored
  64d9816View commit details

  Copy full SHA for 64d9816

  Browse repository at this point

• "help wanted" in label to exempt from stale (#1956)

  Show description for 67564fd
  qgallouedec

  authored
  67564fdView commit details

  Copy full SHA for 67564fd

  Browse repository at this point

• Merge branch 'main' into main

  kit1980

  authored
  f2adc3fView commit details

  Copy full SHA for f2adc3f

  Browse repository at this point

Commits on Aug 21, 2024

• Fix global step for consistent checkpointing with global updates (#1950)

  lewtun

  authored
  e529579View commit details

  Copy full SHA for e529579

  Browse repository at this point

Commits on Aug 20, 2024

• Log WandB tables on main process (#1951)

  lewtun

  authored
  dc4cfabView commit details

  Copy full SHA for dc4cfab

  Browse repository at this point

• Add a simple-to-understand example for online DPO (#1947)

  Show description for 66d3a82
  

  vwxyzjn

  and

  lewtun

  authored
  66d3a82View commit details

  Copy full SHA for 66d3a82

  Browse repository at this point

• Don't mark issues as stale if nobody answered (#1949)

  Show description for 3eda856
  qgallouedec

  authored
  3eda856View commit details

  Copy full SHA for 3eda856

  Browse repository at this point

Commits on Aug 19, 2024

• Fix model wrapping for online DPO (#1946)

  lewtun

  authored
  616a273View commit details

  Copy full SHA for 616a273

  Browse repository at this point

• Drop `token` arg in `push_to_hub` (#1945)

  Show description for 9955583
  qgallouedec

  authored
  9955583View commit details

  Copy full SHA for 9955583

  Browse repository at this point

Commits on Aug 18, 2024

• Properly tag models when pushed to 🤗 Hub (#1940)

  Show description for bed205a
  qgallouedec

  authored
  bed205aView commit details

  Copy full SHA for bed205a

  Browse repository at this point

Commits on Aug 17, 2024

• Optional Additional Loss to Center Reward Models' Outputs (#1932)

  Show description for 42933fa
  

  RylanSchaeffer

  and

  qgallouedec

  authored
  42933faView commit details

  Copy full SHA for 42933fa

  Browse repository at this point

• Fix model to save in PPOv2 (#1776)

  Show description for bbdef00
  

  mnoukhov

  and

  qgallouedec

  authored
  bbdef00View commit details

  Copy full SHA for bbdef00

  Browse repository at this point

Commits on Aug 16, 2024

• Add tests for DPO for VLM (#1935)

  Show description for 0956dc1
  qgallouedec

  authored
  0956dc1View commit details

  Copy full SHA for 0956dc1

  Browse repository at this point

Commits on Aug 15, 2024

• Use weights_only for load

  kit1980

  committed
  a80d0f7View commit details

  Copy full SHA for a80d0f7

  Browse repository at this point

Commits on Aug 14, 2024

• Anchored preference optimization loss for DPO (#1928)

  Show description for a7dc892
  

  3 peopleauthored
  a7dc892View commit details

  Copy full SHA for a7dc892

  Browse repository at this point

• Improve DPO/loss doc (#1929)

  Show description for b0372e6
  qgallouedec

  authored
  b0372e6View commit details

  Copy full SHA for b0372e6

  Browse repository at this point

• minor BCO fixes (#1923)

  Show description for c1b272f
  

  3 peopleauthored
  c1b272fView commit details

  Copy full SHA for c1b272f

  Browse repository at this point

• `PartialState().local_main_process_first()` when `map` in examples (#1926)

  Show description for f05f63c
  qgallouedec

  authored
  f05f63cView commit details

  Copy full SHA for f05f63c

  Browse repository at this point

Commits on Aug 13, 2024

• Standardize `dataset_num_proc` usage (#1925)

  Show description for 54f806b
  

  qgallouedec

  and

  lewtun

  authored
  54f806bView commit details

  Copy full SHA for 54f806b

  Browse repository at this point

• Add explicit library name for TRL repos (#1922)

  lewtun

  authored
  a9a7565View commit details

  Copy full SHA for a9a7565

  Browse repository at this point

Commits on Aug 12, 2024

• fix orpo trainer loss device (#1919)

  SunMarc

  authored
  96bb3deView commit details

  Copy full SHA for 96bb3de

  Browse repository at this point

• `torch.cuda.amp.autocast()` -> `torch.amp.autocast("cuda")` (#1921)

  Show description for dbea3da
  qgallouedec

  authored
  dbea3daView commit details

  Copy full SHA for dbea3da

  Browse repository at this point

• `lr_scheduler.step()` call after `optim.step()` (#1918)

  Show description for 150a931
  qgallouedec

  authored
  150a931View commit details

  Copy full SHA for 150a931

  Browse repository at this point

Commits on Aug 9, 2024

• Various args and test fix (#1909)

  Show description for cbcaa46
  qgallouedec

  authored
  cbcaa46View commit details

  Copy full SHA for cbcaa46

  Browse repository at this point

Commits on Aug 7, 2024

• Fix `AlignPropTrainer` import (#1908)

  qgallouedec

  authored
  e3fe28eView commit details

  Copy full SHA for e3fe28e

  Browse repository at this point

Commits on Aug 6, 2024

• Fix GPT2 sentiment notebook reward (#1738)

  Show description for fb0b9ed
  

  cemiu

  and

  qgallouedec

  authored
  fb0b9edView commit details

  Copy full SHA for fb0b9ed

  Browse repository at this point