RounMicLess

PostsComments

RRunPod

•Created by RounMicLess on 12/28/2023 in #⛅｜pods

Cuda out of memory

Autotrain ? I should open an issue ? It’s okay for me, I just want to be sure it doesn’t have a link with runpod/container since I am able to run it on my computer locally

8 replies

RRunPod

•Created by RounMicLess on 12/28/2023 in #⛅｜pods

Cuda out of memory

Yeah I also tried it on A100

8 replies

RRunPod

•Created by RounMicLess on 12/28/2023 in #⛅｜pods

Cuda out of memory

But this phi model is 1.5 bg and now I tried a A40 and got the same problem. Moreover, I don’t have any fluctuation of gpu utilization on the website

8 replies