baldo
RRunPod
•Created by baldo on 10/13/2024 in #⚡｜serverless
H100 NVL
If I've understood the docs correctly, H100 NVL is not available on serverless. Are there any plans to bring it to serverless? The extra 14GB of VRAM over the other GPUs is pretty useful for 70(ish)B parameter LLMs.
6 replies