R
RunPod•3w ago
houmie

Do I need to allocate extra container space for Flashboot?

I'm planning to use Llama3 model that takes about 40 GB space. I believe Flashboot takes a snapshot of the worker and keeps it on the disk to load it within seconds when the worker becomes active. Do I need to allocate enough space on the container for this? In this case, since I'm planning to select a 48 GB vRAM GPU, do I need to allocate 40 GB Model + 48 GB for snapshot + 5 GB extra space = 93 GB container space?
Thanks
3 Replies
digigoblin
digigoblin•3w ago
Flashboot is basically a serverless algorithm and does not require disk space
nerdylive
nerdylive•3w ago
No Container space is for temporary files that you save
houmie
houmie•3w ago
Thanks
Want results from more Discord servers?
Add your server
More Posts
How do saving plans work?I don't quite understand how to enable it. Isn't it better to select a saving plan for a given periWhen servless is used, does the machine reboot if it is executed consecutively? Currently seeing issWhen servless is used, does the machine reboot if it is executed consecutively? Currently seeing issTerminate POD with SSHHello! I use the following command to stop and then terminate the pod using ssh. It stops, but it isPods issuesHello, I can't access my pods for around 13 hours... Some of them have this warning: We have detectHow can I view a generated image or video ?Other than storing it in s3 ?unusual usageHello ! we got billed weirdly this past weekendMaintenance scheduled: 5 days downtime and data loss. What does this mean?My pod is showing this message Maintenance Scheduled This machine is scheduled for kernel and drivePod Maintenance update days afterRam issueHello guys, I am running the setup on the attached picture. The image I am trying to pull is cognitiSlow I/OHey, I am trying to download a 7GB file and run a ffmpeg process to extract an audio from that file