Vllm unfortunately doesn't support switching the model without a restart.
It's not, by far. But vllm or SGLang don't support switching the model.. such a shame.
Vllm unfortunately doesn't support switching the model without a restart.