sslan
RRunPod
•Created by bradfox2 on 11/6/2024 in #⚡｜serverless
Why is 125M from facebook loading into VLLM quickdeploy even though another model is specified?
MODEL_PATH is not being passed properly. Doesn't matter which version of VLLM I use or which model from HF is used
2 replies