Henky!!
How do I install a model with kobold ai?
I highly recommend transitioning to the KoboldCpp template. The original KoboldAI is very old. https://koboldai.org/runpodcpp
6 replies
Cannot Stop pod from RunPod Web UI
Terminate works very similar to stop, the only thing you loose extra is the template settings you launched it with. If you keep those in a notepad somewhere you can relaunch a new one (with the same network storage) very easily. If you don't have network storage at all and no volume storage there is nothing to stop, if shut down there is nothing left at that point. My own KoboldCpp template is designed that way for example, its gone completely since redownloading models on that template is so fast its both faster and cheaper than if my users paid for storage.
7 replies
Cannot Stop pod from RunPod Web UI
People still get wrong expectations that they are renting a machine or a VPS for the price. They aren't. They are renting a docker instance for the price. It would still be nice if runpod kept "stopped" instances as a way of easily launching them again but the moment you "stop" a pod its just disk storage at that point.
7 replies
Can't stop my pod! Only terminate
KoboldCpp doesn't store data and downloads models faster than runpods network storage can load them so you are best off just making pods as you need them. Gives you much more GPU availability that way and its cheaper. If you really want persistent storage for the model its possible though just by adding sufficiently large volume storage but its going to be a worse experience.
6 replies