How much RAM do we have per Serverless endpoint?
I am curious about how does RAM usage work? Since for fly.io you can allocate RAM / CPU, but here for runpod we only choose the GPU/whatever VRAM the GPU has.
But if I am doing something like memory intensive like video / audio processing, will it just crash at some point bc of it?
1 Reply
Solution
ram is least same as vram, most of the time its 25% higher than vram