Should i able to launch a pod using nvidia/cuda docker images?

I am trying to start a pod using nvidia/cuda:12.6.0-cudnn-runtime-ubuntu24.04 (to get both cuda and cudnn). I'm not an a docker expert, but should that work? The pod appears to start, but the licensing message keeps looping in the logs, and i can't SSH into the pod? Any ideas? thx.
Solution:
No, you need to setup it yourself, and add a sleep infinity or a program that's running in the main thread, to make sure the container isn't looping start/stop
Jump to solution
2 Replies
marko.333
marko.333OP4mo ago
i'm having a feeling that the nvidia images do not have a running ssh server?
Solution
nerdylive
nerdylive4mo ago
No, you need to setup it yourself, and add a sleep infinity or a program that's running in the main thread, to make sure the container isn't looping start/stop
Want results from more Discord servers?
Add your server