Can we turn secure cloud instances on/off through some time of trigger function?
Hello everyone! Was wondering if I need to be paying for the pod 24/7 even if i will only be using the llm a couple of times per day, or if it can be turned on at certain times
1 Reply
You can terminate it entirely
And just spin up the LLM as necessary in the pod
if you want this as an API, you are lookign for serverless function
which essentially spins up dynamically as requests come in
If you only "STOP" the pod, you will still pay for the pod basic storage requirement bc it is continuing to persist ur data
(unless you are using a network volume) then the data will persist to network volume, and you'll only have the option to terminate the pod anyways.