yasyf Comments - Answer Overflow

Topics

yasyf

•Created by yasyf on 1/18/2025 in #⚡｜serverless

Can we get our serverless worker limit increased?

@Merrell tagging you since I see you are online!

5 replies

•Created by Quantum Surt on 1/18/2025 in #⚡｜serverless

1s delay between execution done and Finished message

We've noticed this as well!

10 replies

•Created by yasyf on 1/18/2025 in #⚡｜serverless

Can we get our serverless worker limit increased?

thanks! Could we get it upped even more? to around 250 if possible? we're scaling up more on runpod 🙂

5 replies

•Created by yasyf on 1/18/2025 in #⚡｜serverless

Can we get our serverless worker limit increased?

ticket #11949

5 replies

•Created by yasyf on 12/12/2024 in #⚡｜serverless

Constantly getting "Failed to return job results."

This is using client 1.7.7

4 replies

•Created by yasyf on 12/12/2024 in #⚡｜serverless

Constantly getting "Failed to return job results."

Here's a response on the client end from a different invocation.. I'm about to switch everything over to Modal bc this has been happening on and off for weeks now 😦

{'delayTime': 85, 'executionTime': 32890, 'id': '7a0bf5f9-5e21-4302-b518-302e2e253bc5-u1', 'status': 'COMPLETED', 'workerId': 
'pazpzlmr3pkrxx'}

{'delayTime': 85, 'executionTime': 32890, 'id': '7a0bf5f9-5e21-4302-b518-302e2e253bc5-u1', 'status': 'COMPLETED', 'workerId': 
'pazpzlmr3pkrxx'}

4 replies

•Created by Ben on 12/7/2024 in #⚡｜serverless

Serverless request returns None from python client but web status says completed successfully

I'm seeing the same thing, the 400 saying failing to return job results, and then the SDK gets back None in the output. You ever solve?

19 replies

•Created by yasyf on 9/26/2024 in #⚡｜serverless

524 Timeouts when waiting for new serverless messages

oh I'm not using VLLM, I meant the concurrency_modifier

11 replies

•Created by yasyf on 9/26/2024 in #⚡｜serverless

524 Timeouts when waiting for new serverless messages

its 4 right now. whats recommended value?

11 replies

•Created by yasyf on 9/26/2024 in #⚡｜serverless

524 Timeouts when waiting for new serverless messages

yes, using LLMs. ok cool, will keep an eye out for that. anything else to do in the interim?

11 replies

•Created by yasyf on 9/26/2024 in #⚡｜serverless

524 Timeouts when waiting for new serverless messages

and the result is the idle timeout is not expected and the worker stays alive longer than it should

11 replies

•Created by yasyf on 9/26/2024 in #⚡｜serverless

524 Timeouts when waiting for new serverless messages

yea I understand all of that, but the 524 happens very reproducibly and very frequently, so I dont think its a temp network problem

11 replies