RunPod•3d ago

HF Cache

Hey I got this email from you guys

 Popular Hugging Face models have super fast cold-start times now
We know lots of our developers love working with Hugging Face models. So we decided to cache them on our GPU servers and network volumes.

 Popular Hugging Face models have super fast cold-start times now
We know lots of our developers love working with Hugging Face models. So we decided to cache them on our GPU servers and network volumes.

Can you explain what exactly what you man by Hugging Face models cache? Docker Image Templates? Or do you mean when people fetch models from HF via internet you have them cached?

2 Replies

yhlong00000•3d ago

Will have more info and doc coming soon. Basically if you are using hugging face models and it is popular, there is a chance those models will be cached on our servers and give you a fast start

nerdylive•2d ago

i think it's not yet released yet right

Gaming

Programming

HF Cache