meerkat

PostsComments

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

Ooh that's a great idea, thanks so much

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

But yeah, this was confusing so I thought to bring it up here to see if anyone else had this happen

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

I think there's a workaround by installing pytorch manually by building the library from scratch, but that doesn't seem worth the hassle, and also defeats the point of the template

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

Basically, I don't think pytorch 1.13.1 is meant to be run on CUDA 11.8

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

And the mismatch error happens due to a CUDA version check in what I believe is the deepspeed library, I can try to pull up the error if you would like to see

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

Other templates have the correct CUDA version installed (the one listed in the template/image id)

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

If you check nvcc --version

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

But the actual pod uses 11.8

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

In the template it mentions "cuda11.7.1", and pytorch 1.13.0 is built for cuda 11.6 or 11.7 so this makes sense

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

18 replies

RRunPod

•Created by meerkat on 5/1/2024 in #⛅｜pods

Template pytorch-1.13.1 lists cuda 11.7.1 version but is actually cuda 11.8?

Oh I see, thanks. So is the template name wrong then, since it incorrectly says it uses cuda 11.7?

18 replies