nalak
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
thanks
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
fuck
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
so I'd basically need to set up the container on my own with the proper deps to run the model
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
okay, I see
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
thanks for the support
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
I'll just wait for the fix, not in that big of a hurry
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
oof
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
I tried that and it didn't seem to do anything actually
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
ahhhhhhh, got it, nice
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
uh, I can't find that on the page
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
is there a configuration option somewhere for the branch/revision?
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
that sounds correct to me yeah
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
I thought they were called revisions on hf, are they just branches like in git?
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
yeah
48 replies
RRunPod
•Created by nalak on 8/20/2024 in #⚡｜serverless
Running a specific Model Revision on Serverless Worker VLLM
so it just runs nothing
48 replies