R
RunPod4mo ago
abtx

HF Cache

Hey I got this email from you guys
Popular Hugging Face models have super fast cold-start times now
We know lots of our developers love working with Hugging Face models. So we decided to cache them on our GPU servers and network volumes.
Popular Hugging Face models have super fast cold-start times now
We know lots of our developers love working with Hugging Face models. So we decided to cache them on our GPU servers and network volumes.
Can you explain what exactly what you man by Hugging Face models cache? Docker Image Templates? Or do you mean when people fetch models from HF via internet you have them cached?
2 Replies
yhlong00000
yhlong000004mo ago
Will have more info and doc coming soon. Basically if you are using hugging face models and it is popular, there is a chance those models will be cached on our servers and give you a fast start
nerdylive
nerdylive4mo ago
i think it's not yet released yet right

Did you find this page helpful?