nayandhabarde
RRunPod
•Created by Raqqa on 5/1/2024 in #⚡｜serverless
Efficient way to load the model
@agentpietrucha
I did something like
model = Model("realvis.safetensors")
fun generate(event):
....
runpod.serverless.start({"handler": generate})
it loads the model again and again at every request and
2024-06-06T09:29:54Z start container
2024-06-06T09:30:37Z stop container
2024-06-06T09:30:38Z remove container
2024-06-06T09:30:38Z remove network
this also happens then how it would keep the model loaded
10 replies