Flashboot meaning?
Is there any documentation on what it does under the hood?
i am asking because of this:
"FlashBoot reduces majority cold-starts down to 2s, even for LLMs. Make sure to test output quality before enabling."
does that mean it reduces output quality of my models?
2 Replies
The system will keep your worker warm so it response quick. It won’t reduce the output quality
okay thanks