Hawk
RRunPod
•Created by Sven on 10/2/2024 in #⚡｜serverless
Serverless vllm - lora
Hoping this gets merged soon
12 replies
RRunPod
•Created by Sven on 10/2/2024 in #⚡｜serverless
Serverless vllm - lora
Thanks Sven for making this
crazy enable_lora flag was added but not the arg to actually add lora adapters
12 replies