RRunPod•Created by Space Burger on 12/30/2024 in #⛅|pods Is there a limit in the number of threads?
I have pods with different numbers of vcpus. I am running vllm. If I create too many vllm in parallel, I get errors like "can't create thread". Is there a parameter that limits the number of threads per pod?