marshall Comments - Answer Overflow

that depends how many workers you have available, try to set at least 2 if you're using 1 worker only, the requests would sometimes have to wait for the GPU to be available.

12 replies

RRunPod

•Created by Augenbrauensenker on 8/21/2024 in #⚡｜serverless

When ttl is not specificed in policy, one gets 500 with {"error":"ttl must be \u003e= 10,000 ms"}

Default is 24 hours. Maximum is one week. didn't get followed I think?

7 replies

RRunPod

•Created by Augenbrauensenker on 8/21/2024 in #⚡｜serverless

When ttl is not specificed in policy, one gets 500 with {"error":"ttl must be \u003e= 10,000 ms"}

broke our production bot 💀

7 replies

RRunPod

•Created by Augenbrauensenker on 8/21/2024 in #⚡｜serverless

When ttl is not specificed in policy, one gets 500 with {"error":"ttl must be \u003e= 10,000 ms"}

having this same exact issue

7 replies

RRunPod

•Created by Samuel on 3/12/2024 in #⚡｜serverless

Failed Serverless Jobs drain Complete Balance

I've only noticed it just today and I did my best to collect evidences: https://docs.google.com/document/d/1YC6SZBEAeJ9quevTjcwnQ6hekQbgV6GCcecqD8-QQVo/edit?usp=sharing

5 replies

RRunPod

•Created by Samuel on 3/12/2024 in #⚡｜serverless

Failed Serverless Jobs drain Complete Balance

5 replies

RRunPod

•Created by Samuel on 3/12/2024 in #⚡｜serverless

Failed Serverless Jobs drain Complete Balance

@Samuel your best bet is contacting their support team on the website chatbox... I'm afraid the https://discord.com/channels/912829806415085598/1209942179527663667 issue might be happening again

5 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled

moved into DMs

239 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled

That's a great resolution!

239 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled

Still not fully resolved but at least they refunded the credits xd

239 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled

got in touch with sales, they gave back the burned credits based on our 30 day average Right now we're running the model on 16GB which is a bit more expensive due to the longer inference time (despite being 30% cheaper, the model took 60% longer to produce output) so ideally we should go back to 24GB, but we'll have to wait for RunPod's announcement regarding GPU availability... According to sales:

"It's probably going to be a gradient over time rather than a binary state of being resolved/not resolved since we add more capacity on a weekly/biweekly basis; we do announce big supply adds on Discord when they come through so that's probably the best way to keep updated"

which is their answer when I asked "if/when the issue would get resolved"

239 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled

currently trying to run a smaller version of our model on 16GB temporarily 1 week of downtime is too big of an impact for us apparently

239 replies

RRunPod

•Created by Jidovenok on 2/21/2024 in #⚡｜serverless

All 27 workers throttled