DeluxeWalrus
Running 2x H100 80gb. Does this mean my cap is now 160gb of vram?
OutOfMemoryError: CUDA out of memory. Tried to allocate 151.88 GiB (GPU 0; 79.11 GiB total capacity; 55.44 GiB already allocated; 22.45 GiB free; 55.54 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
10 replies