🐧
RRunPod
•Created by jonny9f on 12/24/2023 in #⚡｜serverless
Execution time much longer than delay time + actual time
Thx. Will test it after holidays.
Just glanced at the code, was it really just because of sleep(1) ? If so, that's hilarious ! 😄
I also see a rust binary. Is there a repo for it as well ? I couldn't find it. And does the new version support concurrency_handler ? The code seems to check and use config.max_concurrency instead.
It would be great if you could update the docs to reflect all these changes and features.
14 replies
RRunPod
•Created by jax on 12/25/2023 in #⚡｜serverless
serverless webhook support secret?
Just be aware that query params can be logged/viewed.
If you data is sensitive, another way could be to expose the private key as an env var in your serverless. Then, sign each webhook response and pass the signature along with the response. Your backend would have the same private key so can validate the signature.
I haven't tested it but it should work.
8 replies
RRunPod
•Created by marshall on 12/24/2023 in #⚡｜serverless
Issue with unresponsive workers
Have you tried with >= 1 active worker ? And then send several requests to test scaling.
24 replies
RRunPod
•Created by marshall on 12/24/2023 in #⚡｜serverless
Issue with unresponsive workers
Ah. so I guess the issue is indeed with their job system
24 replies
RRunPod
•Created by marshall on 12/24/2023 in #⚡｜serverless
Issue with unresponsive workers
that depends on your use case. I use LLMs so I just set it to 10s.
24 replies
RRunPod
•Created by marshall on 12/24/2023 in #⚡｜serverless
Issue with unresponsive workers
are you using request count or queue delay ? I had similar issue when using request count and so did a few others. It was advised to use queue delay
24 replies
RRunPod
•Created by jonny9f on 12/24/2023 in #⚡｜serverless
Execution time much longer than delay time + actual time
Yes I have seen this as well. I time the running time my handler takes and usually the execution time was greater by 1+ second.
The last time I brought this up, I was recommended to set at least 1 active worker and do multiple requests to test and reproduce it. I have yet to do that but maybe you can try that ?
14 replies