How do I select a different template to the default in the new RunPod UI?
I might be missing something obvious, but: in the new RunPod Pods > Deploy UI, after selecting a GPU config, how do I pick a template other than the default?
RunPod Pytorch 2.2.10
runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04
There used to be a way to search for other provided templates, but I can't figure out how to do that in the new UI.
Thanks!
26 Replies
Huh… so, I'd selected H100 80GB SXM5 as the GPU config when I posted the message above. I just spotted that if I select (say) L40 or A40 instead, I see a "change template" option that isn't visible with the H100 config. Are alternate templates not available for H100 GPUs now?
I believe its because torch is compiled specifically for H100.
Ah, I see. Thank you!
Not that I'm an expert, but I think its an error. I used to be able to run other templates on the H100. And then for a chunk of today no non-torch templates were loading at all for any GPU's. Now it looks like they have fixed it for most, just not the H100 yet [unless this is now a deliberate change]
you should be able to change templates on h100s now
Ideal. Thanks 🙂
Hi, it seems that i have a problem with the templates too.
Whenever i pick a template, let's say Koboldccp official, all arguments inside are completely blank, which defeats the purpose of a template.
Is there anything i could to to fix it? New ui seems to have broken it.
Ask @Henky!! if he knows about this.
I have heard of this yes
I've already talked with him
But its a runpod bug, I don't know whats causing it
i will just go around and run pytorch instead and apply the notebook
It happens before my template is even running
Probably similar issue to volume disk setting getting lost
Koboldcpp has no volume disk so thats normal
Or the persistent disk I mean