R
RunPod6mo ago
tzk

Receiving "CUDA error: no kernel image is available for execution on the device" error on Serverless

I recently tried to change the Endpoint's GPU and reverted back - I'm now facing an error message "CUDA error: no kernel image is available for execution on the device" in the logs. Looked up on the web and it seems to be CUDA version mismatch. Really not sure how to address this - can anyone help?
3 Replies
Encyrption
Encyrption6mo ago
Did you set an Allowed CUDA version on your endpoint?
tzk
tzkOP6mo ago
No I haven't! And I was wondering what that option was. How do I know which CUDA version to use? (thanks btw)
Encyrption
Encyrption6mo ago
It depends on what your model needs.

Did you find this page helpful?