Multi Node training with torchrun/slurm

Has anyone here ever tried multinode on runpod? I am thinking of setting this up but if people have encountered prohibitive network speeds I do not see a reason to.
6 Replies
flash-singh
flash-singh5mo ago
you won't be able to do this without our multi-node feature since you don't get access to internal ips
nerdylive
nerdylive5mo ago
multi-node??
flash-singh
flash-singh5mo ago
its a new service we are currently alpha testing, will let you deploy multi node clusters for training or other use cases with 100+ Gbps private networking
nerdylive
nerdylive5mo ago
h100s gonna run out soon
flash-singh
flash-singh5mo ago
a100s / h100s, likely will open beta next month
nerdylive
nerdylive5mo ago
nice i don't think ill use that hasn't explored that much to clusters yet hahah seems like a great feature
Want results from more Discord servers?
Add your server