Skip to content

Tags: s0l/vllm

Tags

v0.24.0

Toggle v0.24.0's commit message
[KV-Offloading] Fix tensors_per_block stride (vllm-project#46888)

Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
(cherry picked from commit 798185d)

v0.24.0rc2

Toggle v0.24.0rc2's commit message
Fix P/D with DP Supervisor (vllm-project#46628)

Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
(cherry picked from commit c5e3c40)

v0.24.0rc1

Toggle v0.24.0rc1's commit message
[CI/Build] Fix topk histogram build on SM75 (vllm-project#46550)

Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
(cherry picked from commit 191826e)

v0.23.1rc0

Toggle v0.23.1rc0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[Bugfix][CI] Update Dockerfile dependency graph PNG (vllm-project#45602)

Signed-off-by: sfeng33 <4florafeng@gmail.com>

v0.23.0

Toggle v0.23.0's commit message
[Bugfix][Frontend] Cap fastapi < 0.137 to avoid prometheus-fastapi-in…

…strumentator crash on serve startup

A fresh pip install pulls fastapi 0.137, whose new _IncludedRouter route type
(a BaseRoute with no .path) breaks prometheus-fastapi-instrumentator's route
iteration -> 'vllm serve' dies at startup with:
  AttributeError: '_IncludedRouter' object has no attribute 'path'

requirements/common.txt pinned fastapi[standard]>=0.115.0 with no upper bound.
Cap to <0.137; lift once the instrumentator handles _IncludedRouter
(trallnag/prometheus-fastapi-instrumentator#370).

Signed-off-by: avesed <trevor.lijunlin@gmail.com>

v0.23.0rc2

Toggle v0.23.0rc2's commit message
[Docker] Fix CUTLASS DSL cu13 install order in Dockerfile (vllm-proje…

…ct#45204)

Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
(cherry picked from commit 40e065e)

v0.22.1

Toggle v0.22.1's commit message
fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init

Signed-off-by: khluu <khluu000@gmail.com>

v0.22.1rc2

Toggle v0.22.1rc2's commit message
fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init

Signed-off-by: khluu <khluu000@gmail.com>

v0.22.1rc1

Toggle v0.22.1rc1's commit message
[docker] Stop using extra-index-url for flashinfer-jit-cache (vllm-pr…

…oject#44366)

Signed-off-by: Kevin H. Luu <khluu000@gmail.com>

v0.22.1rc0

Toggle v0.22.1rc0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
[CI] Make Model Executor test hangs fail fast with a traceback (vllm-…

…project#43971)

Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>