Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Jun 16, 2026

• [DSV4][Minor] Fix supported KV cache dtypes (#44892)

  Show description for f4359a7
  WoosukKwon

  authored
  f4359a7

  Copy full SHA for f4359a7

Commits on Jun 15, 2026

• [EP] Enable DBO with NIXL EP (#45275)

  Show description for 3afe659
  itayalroy

  authored
  3afe659

  Copy full SHA for 3afe659

• [EP] Query NIXL EP top-k index dtype (#45298)

  Show description for 16e9117
  itayalroy

  authored
  16e9117

  Copy full SHA for 16e9117

• nixl_ep: Skip post-receive quantization for NVFP4 (#45606)

  Show description for ab8b0fe
  itayalroy

  authored
  ab8b0fe

  Copy full SHA for ab8b0fe

• [Bugfix] Defer block freeing until in-flight steps finish under async scheduling + PD KV consumer (#45357)

  Show description for d467a2a
  

  3 peopleauthored
  d467a2a

  Copy full SHA for d467a2a

• [Frontend] Replace legacy Gemma4 parsers with engine-based implementation (#45588)

  Show description for 76a373e
  

  bbrowning

  and

  sfeng33

  authored
  76a373e

  Copy full SHA for 76a373e

• Fix parallel_tool_calls: null treated as false instead of default true (#44955)

  Show description for 25ee659
  factnn

  authored
  25ee659

  Copy full SHA for 25ee659

• [Model Runner V2][Bugfix] Fix MRV2 LoRA warmup (#35536)

  Show description for eacff17
  

  3 peopleauthored
  eacff17

  Copy full SHA for eacff17

• [Frontend] Skip structural tags for auto tool_choice without strict mode (#45600)

  Show description for cd9078f
  sfeng33

  authored
  cd9078f

  Copy full SHA for cd9078f

• [Perf] Optimize DSv4 prefill chunk planning, 4.0% E2E Throughput Improvement (#45061)

  Show description for e18fe93
  yewentao256

  authored
  e18fe93

  Copy full SHA for e18fe93

• [Bugfix] Chat Completions Harmony Refactor Clean up (#45464)

  Show description for 51ec5cf
  

  yzong-rh

  and

  bbrowning

  authored
  51ec5cf

  Copy full SHA for 51ec5cf

• [KV Offloading] Implement `reset_cache` for `TieringOffloadingManager` (#44541)

  Show description for 7e612a0
  

  ronensc

  and

  mergify[bot]

  authored
  7e612a0

  Copy full SHA for 7e612a0

• [Model] Add MiniMax M3 support (#45381)

  Show description for 0a1c503
  

  9 peopleauthored
  0a1c503

  Copy full SHA for 0a1c503

• [AMD][Bugfix][Quantization] Honor fused-name match in is_layer_skipped (#43981)

  ZiguanWang

  authored
  a3195fa

  Copy full SHA for a3195fa

• [Chore] Consolidate reasoning/tool parser attributes into unified Parser in chat serving (#45548)

  Show description for 0d80979
  sfeng33

  authored
  0d80979

  Copy full SHA for 0d80979

• [Bugfix] Two-phase KV allocation for cross-group prefix cache hits (supersedes #33775) (#44409)

  Show description for 588db18
  Saddss

  authored
  588db18

  Copy full SHA for 588db18

• Remove redundant Triton KV cache dtype asserts and enforce architectural support (fp8 >= sm89) (#43914)

  Show description for fa63bb9
  

  mikekg

  and

  mikekgfb

  authored
  fa63bb9

  Copy full SHA for fa63bb9

• Fix the E8M0 scale computation in the MXFP4 (W4A4) MOE CUTLASS kernel (#43557)

  Show description for 5ed15f4
  

  3 peopleauthored
  5ed15f4

  Copy full SHA for 5ed15f4

• (security) Enforce audio upload size limit before full file materialization (#45510)

  Show description for b997071
  jperezdealgaba

  authored
  b997071

  Copy full SHA for b997071

• [Bugfix] Unset HF's default max_new_tokens for DiffusionGemma (#45417)

  Show description for 6c5872e
  martin-kukla

  authored
  6c5872e

  Copy full SHA for 6c5872e

• [Docs] Update the online serving docs. (#45676)

  Show description for 1d88c4d
  noooop

  authored
  1d88c4d

  Copy full SHA for 1d88c4d

• [ROCm][Doc] Add installation notes about python version requirement (#45671)

  Show description for 25c53d1
  vllmellm

  authored
  25c53d1

  Copy full SHA for 25c53d1

• [XPU] skip UT test_with_ngram_gpu_spec_decoding (#44423)

  Show description for 9872921
  Yejing-Lai

  authored
  9872921

  Copy full SHA for 9872921

• [Bugfix][Rust Frontend] Make metrics respect --served-model-name (#45465)

  Show description for c17e2f7
  reidliu41

  authored
  c17e2f7

  Copy full SHA for c17e2f7

• [Rust Frontend] Support `parallel_tool_calls = false` (#44760)

  Show description for 40eac9a
  FAUST-BENCHOU

  authored
  40eac9a

  Copy full SHA for 40eac9a

• [Models] Fix MiMo v2.x QKV TP sharding + FP4 support (#45200)

  Show description for b5adb02
  

  TheEpicDolphin

  and

  mergify[bot]

  authored
  b5adb02

  Copy full SHA for b5adb02

• [Rust Frontend] Add external→internal request-id map for abort() (#45137)

  Show description for 64833f8
  sahilsGit

  authored
  64833f8

  Copy full SHA for 64833f8

• [Bugfix][Rust] Sync EngineCoreReadyResponse with the Python dataclass (#45557)

  Show description for ddad5db
  

  wseaton

  and

  BugenZhao

  authored
  ddad5db

  Copy full SHA for ddad5db

• [Bugfix] Reject out-of-range temperature values in SamplingParams (#44965)

  Show description for ebb0a71
  panpan0000

  authored
  ebb0a71

  Copy full SHA for ebb0a71

• [Feature][Frontend] Report multimodal token counts in usage.prompt_tokens_details (#45458)

  Show description for 48df95c
  Sunt-ing

  authored
  48df95c

  Copy full SHA for 48df95c

• [Model] Remove XverseForCausalLM (#45638)

  Show description for 7df4fe1
  

  xianbaoqian

  and

  claude

  authored
  7df4fe1

  Copy full SHA for 7df4fe1

• [Bugfix][V1] Split V2 model-runner attention groups on num_heads_q (#45564)

  Show description for b8336c3
  

  3 peopleauthored
  b8336c3

  Copy full SHA for b8336c3

• Fix included router missing path for `FastAPI >=0.137` (#45629)

  Show description for e8d3e22
  

  ywang96

  and

  claude

  authored
  e8d3e22

  Copy full SHA for e8d3e22

• [Frontend] Add Streaming Parser Engine and new Qwen3 Parser (#45413)

  Show description for c4a3f9d
  

  bbrowning

  and

  sfeng33

  authored
  c4a3f9d

  Copy full SHA for c4a3f9d

• [Bugfix][CI] Update Dockerfile dependency graph PNG (#45602)

  Show description for e3e3cd5
  sfeng33

  authored
  e3e3cd5

  Copy full SHA for e3e3cd5