Serverless worker failing - how do I stop it

I have a couple of questions. I use Runpod Serverless to power a ComfyUI API - it works well most of the time but today I noticed one of my serverless workers kept failing. The errors only occured with one of the workers, the others performed fine. Why would this be? and is there a way of terminating specific workers? also, how can I get notified if one of them is playing up? Thanks!
13 Replies
yhlong00000
yhlong000006mo ago
Can you post the log and pod id here?
nerdylive
nerdylive6mo ago
Yes there is a terminate button when you click your worker
testymctestface
testymctestfaceOP6mo ago
zelboxshlxhhqn
nerdylive
nerdylive6mo ago
What's wrong
testymctestface
testymctestfaceOP6mo ago
this worker stopped completing jobs from about 13:30 yesterday trying to ascertain why so it doesn't happen again
nerdylive
nerdylive6mo ago
Is it running?
testymctestface
testymctestfaceOP6mo ago
is restricted the GPU type so that specific worker is no longer running others are working fine
nerdylive
nerdylive6mo ago
I think it's best just to remove that speicific one then
testymctestface
testymctestfaceOP6mo ago
ok thanks for the tip on terminating workers.
nerdylive
nerdylive6mo ago
Your welcome
yhlong00000
yhlong000006mo ago
File "/comfyui/execution.py", line 151, in recursive_execute Also from log, seems bunch of errors from this file on line 151, maybe take a look what it is trying to do and why it fails.
testymctestface
testymctestfaceOP6mo ago
thanks! going to try and build docker image again and make it a little more robust
Want results from more Discord servers?
Add your server