arthrod.
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Fixed!
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Exactly! So we really need that compatible
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Not now but eventually the protocol will lose the text completion endpoint https://platform.openai.com/docs/api-reference/introduction
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
And considering text completion is set to bd deprecated....
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Happy to test but need instructions haha
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Pretty please
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Thank you!
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Guys, this is pretty serious issue... One of the main models out there can't be served by RunPod..
63 replies
RRunPod
•Created by houmie on 5/1/2024 in #⚡｜serverless
Which version of vLLM is installed on Serverless?
Having the same issue..
63 replies