nuck
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Would you like us to test by creating an image with a baked in model as well?
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
I'd be happy to test the vllm upgrade as if you still need ppl
63 replies