RootsInfo
RootsInfo
RRunPod
Created by RootsInfo on 3/29/2025 in #⛅|pods
Need Help with Auto GPU Shutdown & Startup
Hey everyone! I'm new to RunPod and exploring it for my AI workloads. I’d like to optimize GPU usage by setting up a system where the GPU server automatically shuts down when idle and starts up again only when a job or request needs it. Is there a clean way to achieve this using RunPod's features—like APIs, webhooks, or serverless functions? Also, I'd really appreciate if anyone could share the pros and cons of implementing such a setup (like boot time delays, possible missed requests, or cost-saving benefits). Thanks a lot in advance! Excited to be part of this community.
3 replies