jax
RRunPod
•Created by jax on 10/20/2024 in #⚡｜serverless
job timed out after 1 retries
Indeed it should be caused by the new version of runpod, but which version is good, I'm testing it out
4 replies
RRunPod
•Created by jax on 10/20/2024 in #⚡｜serverless
job timed out after 1 retries
I just specified runpod version 1.7.0 and am currently building docker, will test the results in a bit
4 replies
RRunPod
•Created by jax on 6/25/2024 in #⚡｜serverless
worker no execute
Is the process that complicated? I've promoted runpod to countless people before because I thought it had prompt customer service, but why is the process so complicated
19 replies
RRunPod
•Created by jax on 6/25/2024 in #⚡｜serverless
worker no execute
Here's the full log, docker image templates id 98y63mu2ic, multiple wokers are allowed at the same time and only this worker has problems
19 replies
RRunPod
•Created by jax on 6/25/2024 in #⚡｜serverless
worker no execute
The 1st one executed nothing I canceled it manually, the 2nd one canceled it after a timeout and it looks like it was not assigned to a GPU
19 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Okay, thank you both. Come back if you have any other questions later
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Because I have a lot of customization, not enough I should still learn a lot of the code here, thanks
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Okay, I'll take a look.
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
How does this work exactly?
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Actually, it's not just vram, but also comfyui sever, which I'd like to restart on every request, so I wish there was a way to handle it simply by just clearing the
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Yes, and I will optimize the code to be more GPU efficient for different user inputs
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
What can I do so that my serverless handles each request with a completely new environment? And not be affected by old requests.
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
So if I don't have an action in my code that will clear the GPU, it could be affected yes?
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Will the GPU be emptied, won't there be any effects from the last job?
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Because I've found that it causes chaining problems here, where there was only 1 task that was causing OOM, but there were many
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
Let's move on to the next question, what does the serveless environment look like after the old serverless task has finished running and a new task comes in? (without flash boot and activiy worker enabled)
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
@digigoblin @nerdylive
116 replies
RRunPod
•Created by jax on 6/17/2024 in #⚡｜serverless
When servless is used, does the machine reboot if it is executed consecutively? Currently seeing iss
I've reproduced the problem, and it's due to GPU OOM.
116 replies