Can't stop my pod! Only terminate
I have an H100 SXM running on koboldcpp - I can't figure out how to stop the pod. There's no stop button in the UI. I can only terminate it. How do I simply pause it, so that I can unpause it later and continue?
2 Replies
koboldcpp does not use volume storage so there wont be stop button
KoboldCpp doesn't store data and downloads models faster than runpods network storage can load them so you are best off just making pods as you need them. Gives you much more GPU availability that way and its cheaper. If you really want persistent storage for the model its possible though just by adding sufficiently large volume storage but its going to be a worse experience.
H100 SXM is also overkill for KCPP, A100 should be close and much cheaper
Would still be nice if that was a thing so they can quickly spin one up again with identical settings