Henky!!
Henky!!
RRunPod
Created by jphipps on 3/25/2025 in #⛅|pods
L40 Thermal throttling
Also account for memory heat, that can sometimes cause seperate issues
17 replies
RRunPod
Created by Arsen32 on 3/26/2025 in #⛅|pods
How do I install a model with kobold ai?
The default model I just link will be miles beyond whatever one you chose will be
6 replies
RRunPod
Created by Arsen32 on 3/26/2025 in #⛅|pods
How do I install a model with kobold ai?
I highly recommend transitioning to the KoboldCpp template. The original KoboldAI is very old. https://koboldai.org/runpodcpp
6 replies
RRunPod
Created by somedude on 1/30/2025 in #⛅|pods
Cannot Stop pod from RunPod Web UI
Terminate works very similar to stop, the only thing you loose extra is the template settings you launched it with. If you keep those in a notepad somewhere you can relaunch a new one (with the same network storage) very easily. If you don't have network storage at all and no volume storage there is nothing to stop, if shut down there is nothing left at that point. My own KoboldCpp template is designed that way for example, its gone completely since redownloading models on that template is so fast its both faster and cheaper than if my users paid for storage.
7 replies
RRunPod
Created by somedude on 1/30/2025 in #⛅|pods
Cannot Stop pod from RunPod Web UI
People still get wrong expectations that they are renting a machine or a VPS for the price. They aren't. They are renting a docker instance for the price. It would still be nice if runpod kept "stopped" instances as a way of easily launching them again but the moment you "stop" a pod its just disk storage at that point.
7 replies
RRunPod
Created by somedude on 1/30/2025 in #⛅|pods
Cannot Stop pod from RunPod Web UI
Minor correction, only pods with volume storage
7 replies
RRunPod
Created by jphipps on 3/4/2025 in #⛅|pods
4090 Power capped
Try a different datacenter
6 replies
RRunPod
Created by benjamin_n on 2/27/2025 in #⛅|pods
Spot instances dissappearing??
Spot instance without persistent storage dissapears completely when someone outbids you
5 replies
RRunPod
Created by Rob Guerrero on 3/1/2025 in #⛅|pods
How to connect using WinSCP to community pod?
WinSCP relies on a forwarded SSH port so if you use community cloud make sure to enable the Public IP checkbox to only obtain instances that allow this
6 replies
RRunPod
Created by FackJox on 2/25/2025 in #⛅|pods
how do I fork a community template
Its when you deploy a pod
22 replies
RRunPod
Created by FackJox on 2/25/2025 in #⛅|pods
how do I fork a community template
No description
22 replies
RRunPod
Created by FackJox on 2/25/2025 in #⛅|pods
how do I fork a community template
No description
22 replies
RRunPod
Created by FackJox on 2/25/2025 in #⛅|pods
how do I fork a community template
When you deploy it edit it before deploying. Disk size is an easy edit in the UI
22 replies
RRunPod
Created by nycguy54 on 2/24/2025 in #⛅|pods
Can't stop my pod! Only terminate
Would still be nice if that was a thing so they can quickly spin one up again with identical settings
6 replies
RRunPod
Created by nycguy54 on 2/24/2025 in #⛅|pods
Can't stop my pod! Only terminate
H100 SXM is also overkill for KCPP, A100 should be close and much cheaper
6 replies
RRunPod
Created by nycguy54 on 2/24/2025 in #⛅|pods
Can't stop my pod! Only terminate
KoboldCpp doesn't store data and downloads models faster than runpods network storage can load them so you are best off just making pods as you need them. Gives you much more GPU availability that way and its cheaper. If you really want persistent storage for the model its possible though just by adding sufficiently large volume storage but its going to be a worse experience.
6 replies
RRunPod
Created by Milad on 2/11/2025 in #⛅|pods
EU-RO-1 consistently slow network performance compared to other data centers
Just ask internally if you can be given it yet
14 replies
RRunPod
Created by Milad on 2/11/2025 in #⛅|pods
EU-RO-1 consistently slow network performance compared to other data centers
Its fine but they need to give you that role so theres no confusion
14 replies
RRunPod
Created by Milad on 2/11/2025 in #⛅|pods
EU-RO-1 consistently slow network performance compared to other data centers
They basically try to get people in DM's / other discords to steal crypto
14 replies