teddycatsdomino
RRunPod
•Created by Jidovenok on 2/21/2024 in #⚡｜serverless
All 27 workers throttled
This is helpful, thank you Justin!
239 replies
RRunPod
•Created by Jidovenok on 2/21/2024 in #⚡｜serverless
All 27 workers throttled
Ok, I'll give it a shot. That implies that I could ditch the network volume and use the global region which should help tremendously with availability.
239 replies
RRunPod
•Created by ssssteven on 1/7/2024 in #⚡｜serverless
What does the delay time and execution mean in the request page?
You've just answered a question I posted in another thread. Where does that 35gb number come from? I think we could probably bundle everything into a container around that size.
31 replies
RRunPod
•Created by Jidovenok on 2/21/2024 in #⚡｜serverless
All 27 workers throttled
On a similar note, is there a best practice regarding when to use a network volume and when to bundle models into our image? If we have 20gb of models, should that all just be bundled or should we be using a network volume?
239 replies
RRunPod
•Created by Jidovenok on 2/21/2024 in #⚡｜serverless
All 27 workers throttled
I have a few questions here. What exactly is best practice when availability runs low in the region where we have a network volume. Should we keep endpoints active in multiple regions?
239 replies
RRunPod
•Created by ssssteven on 1/7/2024 in #⚡｜serverless
What does the delay time and execution mean in the request page?
I'm seeing a few parallel conversations about this in different Discord threads. The advice in other threads was to try other regions.
31 replies
RRunPod
•Created by ssssteven on 1/7/2024 in #⚡｜serverless
What does the delay time and execution mean in the request page?
Is there anything we can do about throttled workers?
31 replies
RRunPod
•Created by ssssteven on 1/7/2024 in #⚡｜serverless
What does the delay time and execution mean in the request page?
I'm also trying to understand delay time and what we can do to improve. I'm getting delay times that are in excess of 10 minutes with only a single queued request. I have five workers (all GPU throttled).
31 replies
520: Web server is returning an unknown error
I may have some additional questions when I get up and running with serverless, it sounds like you've got a fair bit of experience there! I really appreciate your patience. Thanks again!
104 replies
520: Web server is returning an unknown error
But I've confirmed the Authorization header is sent, but not received.
I logged the outgoing request headers both in Postman and through our app, and I logged what was received in the server code. The header is just not there.
104 replies
520: Web server is returning an unknown error
I have a Firebase Functions back-end for most other tasks. This really is for image generation. We haven't written all the handlers yet for runpod serverless, we wanted to do an inital test on GPU cloud first.
104 replies