prongs
RRunPod
•Created by prongs on 10/30/2024 in #⚡｜serverless
Job delay
Hello, I have been seeing an increase in delay time while workers boot up, even while using Flashboot. I am using 1.5.3 which seems to have improved it a bit but not significantly. Having said that, is there an API that can be called to boot up the worker if there is an incoming request in let's say 5 seconds. This would ensure that the worker is warm and ready when it arrives. Does idle timeout perform a similar function?
3 replies
RRunPod
•Created by prongs on 10/22/2024 in #⚡｜serverless
Issues with network volume access
It seems like there is a latency in accessing files from serverless workers.
Error on the worker:
2024-10-22T18:36:15.970116008Z CompletedProcess(args=['python3', '/runpod-volume/script3.py', 'xx', 'xx-xx'], returncode=1, stdout='File /runpod-volume/xx/xx/file.txt not found after 15 seconds. Exiting.\n', stderr='')
root@9bd985fc78bf:/workspace/xx/xx# ls -ltr
total 45
-rwxrwxrwx 1 root root 46062 Oct 22 18:35 file.txt
Not sure why the pod was unable to find it. Started happening last night pacific time.
DC: EU-RO-1
19 replies
RRunPod
•Created by prongs on 9/23/2024 in #⚡｜serverless
Bad pods on Serverless
I see that about 20-30% workers that are spawned fail with this error
error starting: Error response from daemon:
error starting: Error response from daemon: No such container
Can you please look into this? serverless endpoint id: 1busjme5syomep
17 replies
RRunPod
•Created by prongs on 7/15/2024 in #⚡｜serverless
Additional delayed time for A100s
Today, my Serverless endpoint is performing jobs with a high delayed time even with flashbot. A100s. Any issues?
1 replies
RRunPod
•Created by prongs on 6/25/2024 in #⚡｜serverless
Environment Variable in Serverless
Hello, quick question, how do I pass environment variables in a request for serverless endpoint? Espcially assign them with a value dynamically while sending a request.
6 replies