Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on May 11, 2026

• bugfix(flashinfer,dcp): remove kv_cache_layout for BatchDCPPrefillWrapper._new_tokens. (#38895)

  Show description for b1b5972
  pisceskkk

  authored
  b1b5972

  Copy full SHA for b1b5972

• fix nixl side-channel host selection (#41806)

  Show description for f9f770c
  

  shaharmor98

  and

  mergify[bot]

  authored
  f9f770c

  Copy full SHA for f9f770c

• Document MolmoWeb hf_overrides (#42163)

  Show description for 5cba683
  hqhq1025

  authored
  5cba683

  Copy full SHA for 5cba683

• [CI/Build] Reduce LoRA model tests. (#42266)

  Show description for 05d610e
  jeejeelee

  authored
  05d610e

  Copy full SHA for 05d610e

• [Frontend] Return rendered prompt text in chat completion response (#42052)

  Show description for 581b5e9
  

  4 peopleauthored
  581b5e9

  Copy full SHA for 581b5e9

• [Misc] Replace mamba_type string literals with MambaAttentionBackendEnum (#41188)

  Show description for 5536fc0
  wangxiyuan

  authored
  5536fc0

  Copy full SHA for 5536fc0

• [ROCm][Bugfix]: dynamically align BLOCK_DMODEL with Lv in MLA decode kernel (#41119)

  Show description for 7f95e66
  vllmellm

  authored
  7f95e66

  Copy full SHA for 7f95e66

• [Bugfix] Gemma 4 chat template crash with missing tool name and tool id (#42188)

  Show description for b168752
  yzong-rh

  authored
  b168752

  Copy full SHA for b168752

• add fused mhc_post_pre kernel (#41536)

  Show description for 171019a
  

  gnovack

  and

  george

  authored
  171019a

  Copy full SHA for 171019a

• Fix Molmo2 image token metadata (#42162)

  Show description for 879a8c3
  hqhq1025

  authored
  879a8c3

  Copy full SHA for 879a8c3

Commits on May 10, 2026

• [MoE] Move various experts classes to fused_moe/experts/ (#41979)

  Show description for 1b57eb4
  

  4 peopleauthored
  1b57eb4

  Copy full SHA for 1b57eb4

• [Performance] Make safetensors checkpoint prefetch settings configurable (#41499)

  Show description for 21943d4
  mmangkad

  authored
  21943d4

  Copy full SHA for 21943d4

• [DSV4] Add PP support for deepseek-v4 (#41694)

  Show description for f396bee
  

  Isotr0py

  and

  zixi-qi

  authored
  f396bee

  Copy full SHA for f396bee

• [Bugfix][Mamba] IMA in causal_conv1d kernel for long sequences (#41617)

  Show description for 215e2f7
  

  Flink-ddd

  and

  mergify[bot]

  authored
  215e2f7

  Copy full SHA for 215e2f7

• [KV Offload] Pass ReqContext to touch(), complete_load(), and complete_store() (#41366)

  Show description for e175192
  ronensc

  authored
  e175192

  Copy full SHA for e175192

• [CPU] Fix spec decode kernel signatures for synthetic mode compatibility (#41932)

  Show description for a54f0d1
  

  jmamou

  and

  benchislett

  authored
  a54f0d1

  Copy full SHA for a54f0d1

• [Bugfix] Fuse Qwen3.5 in_qkvz_proj forwarding with LoRA enabled (#37912)

  Show description for 48698b1
  Isotr0py

  authored
  48698b1

  Copy full SHA for 48698b1

• [ROCm] Cap Triton paged attention block size to fix ROCm shared memory OOM (#38502)

  Show description for 0a309b5
  AndreasKaratzas

  authored
  0a309b5

  Copy full SHA for 0a309b5

• [CI] Trigger LoRA test when changing MoE code. (#42196)

  Show description for 84f7a55
  jeejeelee

  authored
  84f7a55

  Copy full SHA for 84f7a55

• [Docs] Fix broken local links (#42160)

  Show description for a2c9d54
  chfeng-cs

  authored
  a2c9d54

  Copy full SHA for a2c9d54

• Add @zyongye to CODEOWNERS (#42200)

  Show description for 301305c
  zyongye

  authored
  301305c

  Copy full SHA for 301305c

• Fix mypy failure on main (#42197)

  Show description for efd0e77
  mmangkad

  authored
  efd0e77

  Copy full SHA for efd0e77

• [Frontend][Bugfix] Abort ASR engine requests on cancellation (#41266)

  Show description for a5d0a5a
  

  3 peopleauthored
  a5d0a5a

  Copy full SHA for a5d0a5a

• [ROCm][CI] Fix NIXL spec-decode acceptance startup and diagnostics (#41313)

  Show description for f284012
  AndreasKaratzas

  authored
  f284012

  Copy full SHA for f284012

• [Bugfix][KV Transfer][NIXL] Notify P node on pre-admission rejection to free stranded KV blocks (#41269)

  Dao007forever

  authored
  3f5bd48

  Copy full SHA for 3f5bd48

• [ROCm][CI] Stabilize ROCm shutdown and distributed compile CI (#41573)

  Show description for fb1ac80
  AndreasKaratzas

  authored
  fb1ac80

  Copy full SHA for fb1ac80

• [Bugfix] Fix DeepSeek v4 topk numerical issue for unaligned max-model-len (#42169)

  wzhao18

  authored
  986edc8

  Copy full SHA for 986edc8

• docs: clarify Gemma 4 assistant speculative decoding (#42180)

  Show description for 27d3bac
  AbhiOnGithub

  authored
  27d3bac

  Copy full SHA for 27d3bac

• Use CU_MEMCPY_SRC_ACCESS_ORDER_ANY for batch KV cache swaps (#39306)

  Show description for 00b0618
  

  5 peopleauthored
  00b0618

  Copy full SHA for 00b0618

• Handle optional bool-or-string CLI args in get_kwargs (#40951)

  Show description for 0d382ec
  

  cvan20191

  and

  Christian Van

  authored
  0d382ec

  Copy full SHA for 0d382ec

• [CI/Build] Use modelscope's international site for regression test (#42176)

  Show description for 1029e5e
  Isotr0py

  authored
  1029e5e

  Copy full SHA for 1029e5e

• [Bugfix] Fix SP pass for multimodal models and PP+SP residual handling (#33322)

  Show description for 0b272a6
  

  wangxingran222

  and

  HirokenOvo

  authored
  0b272a6

  Copy full SHA for 0b272a6

• Fix: Nemotron 3 rescue whitespace-only final_content, not just None (#41846)

  Show description for dcb3135
  

  Naveassaf

  and

  mergify[bot]

  authored
  dcb3135

  Copy full SHA for dcb3135

• Add NVFP4 all-gather GEMM fusion for AsyncTP (#41882)

  Show description for bc5fdc1
  

  baonudesifeizhai

  and

  mergify[bot]

  authored
  bc5fdc1

  Copy full SHA for bc5fdc1

• [Bugfix] Skip routed-experts hot path when disabled (#42148)

  aoshen02

  authored
  006af4b

  Copy full SHA for 006af4b