CudaToolkit >= 12.2
When selecting the POD to deploy, I can filter the GPU supported cuda version up to v12.4. I suppose this refers to the CUDA display driver, right?
The runpod base images however, only provide up to "cuda 12.1.1" which is not the driver- but the cuda toolkit version, correct?
Solution:Jump to solution
You have two types of CUDA
One that shows from nvidia-smi with is max cuda version supported by host.
Version from nvcc --version is one bundled with template
...
3 Replies
Solution
You have two types of CUDA
One that shows from nvidia-smi with is max cuda version supported by host.
Version from nvcc --version is one bundled with template
Example if you have host that runs on CUDA 12.4 all older images should work but if host is running on CUDA 11.8 and you try to run template that uses CUDA 12 it will error out.
thx!
so basically, on the runpod website, in stead of "The CUDA version supported by the GPU." it should be "The HIGHEST CUDA version supported by the GPU." right?
by that host machine