Dj
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
We're rewriting the docs for clarity, I'll send the docs writer a note to make sure he knows about this feature lol
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
but the general premise is the same, just add that to the end you'll be fine :)
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
If you're using requests:
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
The 1.5 minutes a default from our side, without the wait param you can't control how long we keep the connection open from the server side.
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
Interesting, it does look like our libraries like runpod-python use this though.
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
I don't think this is documented, and I'm not a Go user so I may be reading this wrong but you can change that by passing a
wait URL Param as a time in ms (?wait=300000 being the max)16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
It looks like the delay is 1.5 minutes, 9000ms
16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
Do you expect the job to be terminated if it takes too long? You could always use
run with webhook delivery to know when the job is complete?16 replies
RRunPod
•Created by Jackie on 4/2/2025 in #⚡｜serverless
Does "/runsync" return IN_PROGRESS if it doesn't complete with 2 minutes?
runsync will try it's best to finish when your job is completed, but if it's not done it's just not done :<
16 replies
Need Help with Auto GPU Shutdown & Startup
Hey! This sounds like our serverless product, you give us the image to start and when your endpoint receives a request we start the image, load the model, etc and handle the request for you.
This method is a cheaper than running a permanent pod at the expense of a kind of annoying startup time related to loading the models into VRAM to handle your first request. For apps with not a lot of traffic, it'll just be a little slow. You can modify things like how many "Active Workers" you want running (to remedy the startup time problem) and how long a worker will stay alive (in seconds) after it handles a request. It's not possible for serverless to miss requests, we assign each request an id and handle the lifecycle related to finishing a singlular job id for you.
3 replies
Model upload to huggingface is so slow it costs more than training
HuggingFace in particular is kind of weird - we can't really do much about their network speed and they like to throttle users by IP address. It should be better more times than other and if we can work out a way to improve this connection we can.
7 replies
RRunPod
•Created by Talion on 3/28/2025 in #⚡｜serverless
Unexpected Infinite Retries Causing Unintended Charges
Once you do that just let me know, I don't get notified for new support tickets.
6 replies
RRunPod
•Created by Talion on 3/28/2025 in #⚡｜serverless
Unexpected Infinite Retries Causing Unintended Charges
Hey, thank you for your report.
I'm going to ask you to press the button to submit this as a ticket so I can compensate you for your RunPod related spend. I believe we would also be willing to compensate for your OpenAI expenses too, but I (and the rest of support) can only issue credits - so let me know if that's something you're okay with.
Further, I'll submit this to engineering to see why your request didn't stop because this shouldn't happen. I can follow up on that via Discord or Email (or both!) if you have a preference.
6 replies
RRunPod
•Created by 자베르 on 3/26/2025 in #⚡｜serverless
CUDA profiling
It's Nsight I was thinking of that won't work unless you buy out the whole node and ask us to give you permission. :frowning3:
9 replies
RRunPod
•Created by 자베르 on 3/26/2025 in #⚡｜serverless
CUDA profiling
I think so? I believe there's some type of benchmarking, profiling, tool in that domain that requires privileges we don't give our pods because they're containerized. I can look into it a little more in a moment here
9 replies