Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Feb 27, 2025

• [Model] Deepseek GGUF support (#13167)

  SzymonOzog

  authored
  7f0be2aView commit details

  Copy full SHA for 7f0be2a

  Browse repository at this point

• [VLM] Support multimodal inputs for Florence-2 models (#13320)

  Isotr0py

  authored
  edf309eView commit details

  Copy full SHA for edf309e

  Browse repository at this point

• Fix test_block_fp8.py test for MoE (#13915)

  Show description for 788f284
  mgoin

  authored
  788f284View commit details

  Copy full SHA for 788f284

  Browse repository at this point

• [PP] Correct cache size check (#13873)

  Show description for 4b1d141
  zhengy001

  authored
  4b1d141View commit details

  Copy full SHA for 4b1d141

  Browse repository at this point

• [Misc] fixed 'required' is an invalid argument for positionals (#13948)

  Show description for 10c3b8c
  chaunceyjiang

  authored
  10c3b8cView commit details

  Copy full SHA for 10c3b8c

  Browse repository at this point

• [CI/Build] Add examples/ directory to be labelled by `mergify` (#13944)

  Show description for a7f3731
  b8zhong

  authored
  a7f3731View commit details

  Copy full SHA for a7f3731

  Browse repository at this point

• [V1][Metrics] Handle preemptions (#13169)

  markmc

  authored
  cd711c4View commit details

  Copy full SHA for cd711c4

  Browse repository at this point

• [ROCm][V1] Update reshape_and_cache to properly work with CUDA graph padding (#13922)

  SageMoore

  authored
  378b3efView commit details

  Copy full SHA for 378b3ef

  Browse repository at this point

• [misc] Rename Ray ADAG to Compiled Graph (#13928)

  ruisearch42

  authored
  c9944acView commit details

  Copy full SHA for c9944ac

  Browse repository at this point

• Use CUDA 12.4 as default for release and nightly wheels (#12098)

  mgoin

  authored
  ca377cfView commit details

  Copy full SHA for ca377cf

  Browse repository at this point

• [ROCm][Quantization][Kernel] Use FP8 FNUZ when OCP flag is 0 or undefined (#13851)

  Show description for a31614e
  HollowMan6

  authored
  a31614eView commit details

  Copy full SHA for a31614e

  Browse repository at this point

• [Kernel] FlashMLA integration (#13747)

  Show description for f959039
  LucasWilkinson

  authored
  f959039View commit details

  Copy full SHA for f959039

  Browse repository at this point

Commits on Feb 26, 2025

• [BugFix] Make FP8 Linear compatible with torch.compile (#13918)

  Show description for b382a7f
  WoosukKwon

  authored
  b382a7fView commit details

  Copy full SHA for b382a7f

  Browse repository at this point

• [Bugfix] Backend option to disable xgrammar any_whitespace (#12744)

  Show description for 4cb6fa0
  

  wallashss

  and

  joerunde

  authored
  4cb6fa0View commit details

  Copy full SHA for 4cb6fa0

  Browse repository at this point

• [Misc] fixed qwen_vl_utils parameter error (#13906)

  chaunceyjiang

  authored
  d08b285View commit details

  Copy full SHA for d08b285

  Browse repository at this point

• [TPU] use torch2.6 with whl package (#13860)

  Show description for b27122a
  Chenyaaang

  authored
  b27122aView commit details

  Copy full SHA for b27122a

  Browse repository at this point

• [Bugfix] Update expected token counts for Ultravox tests (#13895)

  DarkLight1337

  authored
  934bb99View commit details

  Copy full SHA for 934bb99

  Browse repository at this point

• [Bugfix] Do not crash V0 engine on input errors (#13101)

  Show description for 3f808cc
  joerunde

  authored
  3f808ccView commit details

  Copy full SHA for 3f808cc

  Browse repository at this point

• [Misc]: Add support for goodput on guided benchmarking + TPOT calculation refactor (#13736)

  Show description for ec8a5e5
  b8zhong

  authored
  ec8a5e5View commit details

  Copy full SHA for ec8a5e5

  Browse repository at this point

• [Bugfix] Handle None parameters in Mistral function calls. (#13786)

  fgreinacher

  authored
  215bf15View commit details

  Copy full SHA for 215bf15

  Browse repository at this point

• Add comments on accessing `kv_cache` and `attn_metadata` (#13887)

  Show description for 0ecdd98
  hmellor

  authored
  0ecdd98View commit details

  Copy full SHA for 0ecdd98

  Browse repository at this point

• [Bugfix] Add test example for Ultravox v0.5 (#13890)

  DarkLight1337

  authored
  7b700ecView commit details

  Copy full SHA for 7b700ec

  Browse repository at this point

• [Misc] Fix input processing for Ultravox (#13871)

  ywang96

  authored
  7ca1da0View commit details

  Copy full SHA for 7ca1da0

  Browse repository at this point

• [Misc] Improve LoRA spelling (#13831)

  jeejeelee

  authored
  5157338View commit details

  Copy full SHA for 5157338

  Browse repository at this point

• [v0][Core] Use xgrammar shared context to avoid copy overhead for offline engine (#13837)

  Show description for e206b54
  sethkimmel3

  authored
  e206b54View commit details

  Copy full SHA for e206b54

  Browse repository at this point

• [ROCm] Disable chunked prefill/prefix caching when running MLA on non-cuda platforms (#13844)

  Show description for 1d35662
  SageMoore

  authored
  1d35662View commit details

  Copy full SHA for 1d35662

  Browse repository at this point

• [Doc] fix the incorrect module path of tensorize_vllm_model (#13863)

  tianyuzhou95

  authored
  e656f63View commit details

  Copy full SHA for e656f63

  Browse repository at this point

• Improve pipeline partitioning (#13839)

  hmellor

  authored
  145944cView commit details

  Copy full SHA for 145944c

  Browse repository at this point

• [Kernel][Build/CI] Bump CUTLASS to 3.8 and add initializers for cutlass epilogues (#13797)

  henrylhtsang

  authored
  094b7d9View commit details

  Copy full SHA for 094b7d9

  Browse repository at this point

• [Misc]Code Cleanup (#13859)

  Show description for e1fe759
  noemotiovon

  authored
  e1fe759View commit details

  Copy full SHA for e1fe759

  Browse repository at this point

• [V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729)

  LiuXiaoxuanPKU

  authored
  5629f26View commit details

  Copy full SHA for 5629f26

  Browse repository at this point

• [misc] Show driver IP info when Ray fails to allocate driver worker (#13858)

  Show description for 9ba2804
  ruisearch42

  authored
  9ba2804View commit details

  Copy full SHA for 9ba2804

  Browse repository at this point

• DeepSeek V2/V3/R1 only place `lm_head` on last pp rank (#13833)

  Show description for 2467978
  hmellor

  authored
  2467978View commit details

  Copy full SHA for 2467978

  Browse repository at this point

• [Model] Support Grok1 (#13795)

  Show description for 07c4353
  mgoin

  authored
  07c4353View commit details

  Copy full SHA for 07c4353

  Browse repository at this point

Commits on Feb 25, 2025

• Fix failing `MyGemma2Embedding` test (#13820)

  Show description for 34e3494
  hmellor

  authored
  34e3494View commit details

  Copy full SHA for 34e3494

  Browse repository at this point