aikitoria

PostsComments

RRunPod

•Created by aikitoria on 2/25/2024 in #⛅｜pods

https://www.runpod.io/console/pods keeps reordering servers

this is EXTREMELY infuriating. I keep accidentally deleting the wrong server because it reorders them for either no reason at all or when you start/stop one, etc

5 replies

RRunPod

•Created by aikitoria on 2/24/2024 in #⛅｜pods

ngc tritonserver container image not usable?

I tried to create a pod on a server with cuda >= 12.2 using this image: nvcr.io/nvidia/tritonserver:24.01-trtllm-python-py3 it loads up correctly, but the resulting server is not usable, cannot connect ssh (the window immediately closes after typing passphrase). the same image works fine on servers from vast.ai, what's the issue?

14 replies