Vectris

PostsComments

RRunPod

•Created by Vectris on 11/27/2024 in #⛅｜pods

Unable to boot mi300x

Getting the following error: error starting container: Error response from daemon: error gathering device information while adding custom device "/dev/dri/renderD136": no such file or directory Pod ID: kptjoa8hkns744

15 replies

RRunPod

•Created by Vectris on 11/26/2024 in #⛅｜pods

Mi300x HIP error: no ROCm-capable device is detected

I'm using the Mi300x and getting a RuntimeError: HIP error: no ROCm-capable device is detected using RunPod Pytorch 2.4.0 ROCm 6.1 template, how can I resolve this?

3 replies

RRunPod

•Created by Vectris on 11/13/2024 in #⛅｜pods

How to migrate serverless endpoint to a pod?

I have a strange use case in which I have a functional serverless endpoint that must run on AMD hardware (for none technical reasons) Everything is setup and working currently running on NVIDIA hardware. AMD hardware is not yet available for serverless, can I recreate the serverless behaviour using a pod? I understand the two services are very different, I just need an API that generates an output using AMD hardware.

5 replies