Out of memory errors on 48gb gpu which didn't happen before

Some requests fail due to OOM, but the endpoint uses 48gb and is definitely capable of processing these requests

0 Replies

No replies yetBe the first to reply to this messageJoin

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

16KMembers