muggleborntribute#0
RRunPod
•Created by muggleborntribute#0 on 3/17/2025 in #⚡｜serverless
Serverless docker image deployment
yes, uploaded the lora on hugging face. and base model by unsloth is already on hugging face.
Last time I deployed it by merging the lora weights with base model and then uploading that on hugging face and them deploying using vLLM ui on serverless. but the performance of merged model is not good.
I want to deploy it in any way I can. I thought using docker image was the only option of using lora as it is, without merging it in base model.
8 replies