Receiving "CUDA error: no kernel image is available for execution on the device" error on Serverless
I recently tried to change the Endpoint's GPU and reverted back - I'm now facing an error message "CUDA error: no kernel image is available for execution on the device" in the logs.
Looked up on the web and it seems to be CUDA version mismatch. Really not sure how to address this - can anyone help?
3 Replies
Did you set an Allowed CUDA version on your endpoint?
No I haven't! And I was wondering what that option was. How do I know which CUDA version to use? (thanks btw)
It depends on what your model needs.