A40 Throttled very regularly!
I have a serverless endpoint with 3GPU that is being fully throttled very regularly.
It is fully unusable for long minutes, see screenshot, request are being queued forever.
It has been the case yesterday and today, it's far too unreliable...
1 Reply
@Quantum Surt
Escalated To Zendesk
The thread has been escalated to Zendesk!
Ticket ID: #12,077