Out of memory errors on 48gb gpu which didn't happen before

Some requests fail due to OOM, but the endpoint uses 48gb and is definitely capable of processing these requests
Was this page helpful?