sluzorz

PostsComments

RRunPod

•Created by sluzorz on 8/23/2024 in #⛅｜pods

Maximum number of A40s that can run at one time

I'm looking to run as many A40s to finish a large-scale inference/LLM generation job. How many could I run at one time? 40, 80, 100?

84 replies

RRunPod

•Created by sluzorz on 8/22/2024 in #⛅｜pods

Does RunPod support other repos other than Docker Hub?

Wodering if we can use AWS or GitHub as an alternative

7 replies

RRunPod

•Created by sluzorz on 8/19/2024 in #⛅｜pods

Can pods shutdown from inside the pod itself?

Wondering if the pod can accept a shutdown command to stop billing

10 replies