R
RunPod8mo ago
houmie

What is the meaning behind template on serverless?

I would like to understand how to create a serverless RunPod environment to run vLLM to host a LLM model. What is the purpose of template? Although it's optional, it seems a template can be pre-created and utilised. What is the meaning behind template? Thanks
2 Replies
houmie
houmieOP8mo ago
I think this is just a way to save a set of settings for reusability.
haris
haris8mo ago
Yep pretty much! We have a vLLM template for serverless so you can deploy any LLM from huggingface pretty easily
Want results from more Discord servers?
Add your server