-
|
In vLLM v0.5.5, does --num-scheduler-steps not work with --enable-lora? I'm serving lora adapters via --enable-lora. In vLLM v0.5.5, --num-scheduler-steps cannot be mixed with --enable-lora? |
Beta Was this translation helpful? Give feedback.
Answered by
comaniac
Sep 2, 2024
Replies: 1 comment 1 reply
-
|
It's not supported yet and being tracked by #7528. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks for your quick reply! |
Beta Was this translation helpful? Give feedback.
Answer selected by
ashgold
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
It's not supported yet and being tracked by #7528.