Blake
RRunPod
•Created by star0129 on 11/20/2024 in #⚡｜serverless
LoRA path in vLLM serverless template
6 replies
RRunPod
•Created by star0129 on 11/20/2024 in #⚡｜serverless
LoRA path in vLLM serverless template
Also wondering - any luck @star0129
6 replies
RRunPod
•Created by Blake on 11/28/2024 in #⚡｜serverless
How to cache model download from HuggingFace - Tips?
any am i missing !? any code examples of ensuring it downloads from the network volume & NOT hf
16 replies
RRunPod
•Created by Blake on 11/28/2024 in #⚡｜serverless
How to cache model download from HuggingFace - Tips?
16 replies
RRunPod
•Created by Blake on 11/28/2024 in #⚡｜serverless
How to cache model download from HuggingFace - Tips?
16 replies
RRunPod
•Created by Blake on 11/28/2024 in #⚡｜serverless
How to cache model download from HuggingFace - Tips?
also: it seems like when you change GPU type, the /runpod-volume is deleted/non accessible - is this correct?
16 replies
RRunPod
•Created by NodeOfSums on 11/25/2024 in #⚡｜serverless
What is the normal network volume read speed? Is 3MB/s normal?
what kind of speeds do you typically see?
6 replies
RRunPod
•Created by Blake on 11/28/2024 in #⚡｜serverless
How to cache model download from HuggingFace - Tips?
16 replies