RunPod•2w ago

H100 NVLink

If I buy two 8xH100s, can I use nvlink between multiple GPUs?

6 Replies

Yes I guess if you rent all in one pod like 8x, you can nvlink inside the pod Not multiple pod yet, I gueds Guess*

@Madiator2011 (Work) Pls help

What do you mean by buy?

I wander if there is any way to use multiple 8xH100s on runpod and GPUs on different machines can communicate over NVLink. Thanks

At the moment, we can’t use NVLink. You can only use the machine’s ethernet for communication, which might not be fast enough for your use case.

Thanks for your reply