Lora modules with basic vLLM serverless
Is it possible to use lora modules with default vLLM endpoint ? If not, how is it possible to do it quickly ?
1 Reply
Hi I am interested in this as well. I'd like to add a simple / a the end of my model and for it to find and download the lora
hf_name/model_name/lora_name