Space Burger
Space Burger
RRunPod
Created by Space Burger on 12/30/2024 in #⛅|pods
Is there a limit in the number of threads?
I have pods with different numbers of vcpus. I am running vllm. If I create too many vllm in parallel, I get errors like "can't create thread". Is there a parameter that limits the number of threads per pod?
18 replies
RRunPod
Created by Space Burger on 2/18/2024 in #⛅|pods
screen spot
I am running a script in a screen in a Spot instance. If the instance stops, when it gets available again, is there a way to make the script run again?
4 replies