Tags: s0l/vllm
Tags
Fix P/D with DP Supervisor (vllm-project#46628) Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> (cherry picked from commit c5e3c40)
[CI/Build] Fix topk histogram build on SM75 (vllm-project#46550) Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com> (cherry picked from commit 191826e)
[Bugfix][CI] Update Dockerfile dependency graph PNG (vllm-project#45602) Signed-off-by: sfeng33 <4florafeng@gmail.com>
[Bugfix][Frontend] Cap fastapi < 0.137 to avoid prometheus-fastapi-in… …strumentator crash on serve startup A fresh pip install pulls fastapi 0.137, whose new _IncludedRouter route type (a BaseRoute with no .path) breaks prometheus-fastapi-instrumentator's route iteration -> 'vllm serve' dies at startup with: AttributeError: '_IncludedRouter' object has no attribute 'path' requirements/common.txt pinned fastapi[standard]>=0.115.0 with no upper bound. Cap to <0.137; lift once the instrumentator handles _IncludedRouter (trallnag/prometheus-fastapi-instrumentator#370). Signed-off-by: avesed <trevor.lijunlin@gmail.com>
[Docker] Fix CUTLASS DSL cu13 install order in Dockerfile (vllm-proje… …ct#45204) Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com> (cherry picked from commit 40e065e)
fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init Signed-off-by: khluu <khluu000@gmail.com>
[docker] Stop using extra-index-url for flashinfer-jit-cache (vllm-pr… …oject#44366) Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
[CI] Make Model Executor test hangs fail fast with a traceback (vllm-… …project#43971) Signed-off-by: khluu <khluu000@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>
PreviousNext