Flashboot mode: Need help or documentation
Hi, I'm trying to decrease load time to our serverless endpoint on idle.
I'm building for Stable diffusion usage.
I tried Flashboot before but the all output was repeated.
Is there any documentation or guide on how to create the docker to use it?
Does it work as hibernation saving the memory state?
If so, does it save the latest state after the task finishes?
1 Reply
Output repeated? What is it like
Well flashboot doesn't document how really on the technical side but it works to makes things fast on startup
( when idle to run )
Maybe? But you shouldn't be getting same results because of that
And what template or application are you using