Who to message to increase 80GB serverless endpoint to 3 GPUs/worker instead of 2?
Whenever I try to increase my serverless endpoint to more than 2x GPU/worker for the 80GB cards, it is grayed out. 8x 48GB cards does not fit 405b models but during testing 4x 80GB cards do.
1 Reply
For whoever looking for more than 2 gpu/worker for the high end card, you can open a support ticket and we can adjust it.
https://contact.runpod.io/hc/en-us/requests/new