Sven
RRunPod
•Created by Sven on 10/2/2024 in #⚡｜serverless
Serverless vllm - lora
Is there a way to set the lora-modules (for the vllm docker container --lora-modules lora_adapter1=abc/efg) in the Template, or do i need to use the "standard" vllm container for it?
12 replies