Commits

Branch selector

 main

User selector

MatthewBonanni

All time

Commit History

Commits on Feb 10, 2026

• [Benchmarks] Fix attention benchmark smoke test (#34269)

  Show description for 4293c00
  MatthewBonanni

  authored
  4293c00

  Copy full SHA for 4293c00

Commits on Feb 5, 2026

• [Bugfix] Fix DSV3.2 NVFP4 (#33932)

  Show description for 4145e50
  MatthewBonanni

  authored
  4145e50

  Copy full SHA for 4145e50

Commits on Feb 3, 2026

• [Bugfix] Fix sparse MLA metadata building (#33579)

  Show description for bd8da29
  MatthewBonanni

  authored
  bd8da29

  Copy full SHA for bd8da29

Commits on Feb 2, 2026

• [UX] Format attention backend log line (#33570)

  Show description for 5d1aef3
  MatthewBonanni

  authored
  5d1aef3

  Copy full SHA for 5d1aef3

• [CI] Add DeepSeek V3.2 nightly eval (#33566)

  Show description for 9f8cb81
  MatthewBonanni

  authored
  9f8cb81

  Copy full SHA for 9f8cb81

Commits on Jan 31, 2026

• [Attention] Move MLA `forward` from backend to layer (#33284)

  Show description for aaa901a
  MatthewBonanni

  authored
  aaa901a

  Copy full SHA for aaa901a

Commits on Jan 28, 2026

• [7/N][Attention][Docs] Add documentation for attention backends (#32477)

  Show description for 77c4f45
  MatthewBonanni

  authored
  77c4f45

  Copy full SHA for 77c4f45

• Add attention benchmarking tools (#26835)

  Show description for e82fa44
  

  MatthewBonanni

  and

  claude

  authored
  e82fa44

  Copy full SHA for e82fa44

Commits on Jan 27, 2026

• [Attention] Use `has_flashinfer` helper (#33177)

  Show description for 1cbccb6
  MatthewBonanni

  authored
  1cbccb6

  Copy full SHA for 1cbccb6

• [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064)

  Show description for a608b4c
  MatthewBonanni

  authored
  a608b4c

  Copy full SHA for a608b4c

Commits on Jan 23, 2026

• [Bugfix][CI] Fix pre-commit (#32956)

  Show description for 2d6b537
  MatthewBonanni

  authored
  2d6b537

  Copy full SHA for 2d6b537

Commits on Jan 22, 2026

• [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795)

  Show description for 955b43a
  MatthewBonanni

  authored
  955b43a

  Copy full SHA for 955b43a

• [CI][Attention] Add more CI dependencies for attention tests (#32487)

  Show description for 300622e
  MatthewBonanni

  authored
  300622e

  Copy full SHA for 300622e

Commits on Jan 19, 2026

• [Attention][MLA] Make FLASHINFER_MLA the default MLA backend on Blackwell, and TRTLLM the default prefill (#32615)

  Show description for 1a1fc3b
  

  MatthewBonanni

  and

  yewentao256

  authored
  1a1fc3b

  Copy full SHA for 1a1fc3b

Commits on Jan 17, 2026

• Revert "[Attention][MLA] Make `FLASHINFER_MLA` the default MLA backen… (#32484)

  Show description for 2e7c89e
  MatthewBonanni

  authored
  2e7c89e

  Copy full SHA for 2e7c89e

Commits on Jan 16, 2026

• [CI] Fix LM Eval Large Models (H100) (#32423)

  Show description for bcf2333
  MatthewBonanni

  authored
  bcf2333

  Copy full SHA for bcf2333

Commits on Jan 15, 2026

• [Attention][MLA] Make `FLASHINFER_MLA` the default MLA backend on Blackwell, and TRTLLM the default prefill (#32339)

  Show description for 8ebfaca
  

  MatthewBonanni

  and

  yewentao256

  authored
  8ebfaca

  Copy full SHA for 8ebfaca

Commits on Jan 13, 2026

• [4/N][Attention] Move MLA common to model_executor (#32060)

  Show description for 2263d44
  

  MatthewBonanni

  and

  ProExpertProg

  authored
  2263d44

  Copy full SHA for 2263d44

• [6/N][Attention] Move utils to more appropriate locations (#32215)

  Show description for 98f60e5
  MatthewBonanni

  authored
  98f60e5

  Copy full SHA for 98f60e5

Commits on Jan 12, 2026

• [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054)

  Show description for 20228cb
  MatthewBonanni

  authored
  20228cb

  Copy full SHA for 20228cb

Commits on Jan 10, 2026

• [2/N][Attention] Fix pre-commit errors (#32052)

  Show description for 0308901
  MatthewBonanni

  authored
  0308901

  Copy full SHA for 0308901

Commits on Jan 9, 2026

• [1/N][Attention] Restructure attention: move files (#31916)

  Show description for 2612ba9
  MatthewBonanni

  authored
  2612ba9

  Copy full SHA for 2612ba9

Commits on Jan 8, 2026

• [0/N][Attention] Fix miscellaneous pre-commit issues (#31924)

  Show description for 0d76674
  MatthewBonanni

  authored
  0d76674

  Copy full SHA for 0d76674

Commits on Jan 6, 2026

• [Spec Decode][UX] Add acceptance stats to `vllm bench serve` report (#31739)

  Show description for d498997
  

  MatthewBonanni

  and

  benchislett

  authored
  d498997

  Copy full SHA for d498997

Commits on Jan 5, 2026

• [CI][DeepSeek] Add nightly DeepSeek R1 `lm_eval` tests on H200 (#30356)

  Show description for 276e03b
  

  MatthewBonanni

  and

  mgoin

  authored
  276e03b

  Copy full SHA for 276e03b

Commits on Dec 24, 2025

• [DeepSeek v3.2] Remove unnecessary syncwarps (#31047)

  Show description for 369f47a
  MatthewBonanni

  authored
  369f47a

  Copy full SHA for 369f47a

Commits on Dec 18, 2025

• [UX] Reduce DeepGEMM warmup log output to single progress bar (#30903)

  Show description for 4a8412f
  MatthewBonanni

  authored
  4a8412f

  Copy full SHA for 4a8412f

Commits on Dec 17, 2025

• [Attention] Update tests to remove deprecated env vars (#30563)

  Show description for 7eb6cb6
  MatthewBonanni

  authored
  7eb6cb6

  Copy full SHA for 7eb6cb6

Commits on Dec 15, 2025

• [UX][Attention] Add `attention_config` argument to `LLM()` (#30710)

  Show description for a182be4
  MatthewBonanni

  authored
  a182be4

  Copy full SHA for a182be4

• Update batch invariant to use attention config (#30704)

  Show description for 60dbf7d
  

  MatthewBonanni

  and

  gemini-code-assist[bot]

  authored
  60dbf7d

  Copy full SHA for 60dbf7d

• [Bugfix] Fix ViT with FlashAttention on ROCm (#30703)

  Show description for 51e5b3e
  MatthewBonanni

  authored
  51e5b3e

  Copy full SHA for 51e5b3e

Commits on Dec 13, 2025

• [Docs] Remove references to `VLLM_ATTENTION_BACKEND` (#30564)

  Show description for f5dfbbd
  MatthewBonanni

  authored
  f5dfbbd

  Copy full SHA for f5dfbbd

• [Bugfix] Pass FA version in `MultiHeadAttention` (#30575)

  Show description for 86a3261
  MatthewBonanni

  authored
  86a3261

  Copy full SHA for 86a3261

Commits on Dec 10, 2025

• [Misc] Consistent case for `vllm bench serve` results (#30403)

  Show description for 794a787
  MatthewBonanni

  authored
  794a787

  Copy full SHA for 794a787

Commits on Dec 5, 2025

• [Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

  Show description for 66e674c
  

  4 peopleauthored
  66e674c

  Copy full SHA for 66e674c