LebaneseNinja
KoboldCpp - Official Template broken
I've tried to launch the KoboldCpp template a few times, but am hitting errors. The model I want to use downloads in two parts (split with commas in launch arguments). The downloads finish and append, but the logs show 'rm: cannot remove './mmproj.gguf': No such file or directory' right before it finishes. The container then restarts and the downloads begin again from square one. These same models worked the last week. I have saved the entire logs if needed.
2 replies
Pod seems to behave like 'Spot' even though it's configured for 'On Demand'
I'm using the stable diffusion template, and haven't had any issues for a few days. Now image generation is taking up to 3 mins before it even starts to generate. Nothing in the logs suggests any sort of error or unusual behavior. How can I diagnose what's wrong? I don't want to terminate and try a new pod because I'll have to redownload all my models and loras.
10 replies