RobB
RRunPod
•Created by rewbs on 3/22/2024 in #⚡|serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
Yeah that wouldn't make much sense unfortunately. I raised an issue with the Selkies EGL repo and their feedback was that the driver install shouldn't be necessary but my experience was llvmpipe rendering without it - But I am hopeful there is a solution
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡|serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
My desktop image uses EGL and is derived from Selkies EGL for Kubernetes (linked in the repo). You'll need to install Nvidia display drivers because there is no /dev/dri on RunPod
26 replies
RRunPod
•Created by doc on 2/17/2024 in #⚡|serverless
comfyui + runpod serverless
Startup time for ComfyUI is typically under two seconds
11 replies
RRunPod
•Created by doc on 2/17/2024 in #⚡|serverless
comfyui + runpod serverless
This is from a simple request on a cold start
11 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
I have a bash script that runs over the envs at start and writes them to a file so they can be passed to supervisord processes that would otherwise not have access to them (because it locks its environment) - Anyway, this script replaces $ID in the webhook post variable with '' so it obviously doesnt work. Annoying but easy to fix.
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
Well, I know what is wrong with it and as I suspected it is my fault.
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
Looks like my version is a couple of micro versions behind. I'll have to see if there's an issue there but I'll be spending some time logged into an active worker and shouting at it. Hopefully get to the bottom of it. Thank you for the pointers 🙏
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
That's with a version of the sdk that used to work, which is what suggests it's definitely my fault
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
No the only install for the serverless environment is runpod, python magic and whatever requirements they bring.
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
Actually it's not that old and it's one of your answers (of course it is - they should pay you!) https://www.answeroverflow.com/m/1187367068643885126
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
I'll have to poke around in the sdk I think to figure out what's missing. I assume it's a POST request going to that URL although I found an old article that suggests a job $ID should follow the worker id and in my case there isn't one
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
Thanks @ashleyk I'll try playing around with it but it won't even let me return a simple sting as a test. It's quite frustrating!
I don't think it's a RunPod issue this time though, I think it is me so I'm not blaming them because even with an older SDK that used to work with this worker code it gives me the 404. Wondering if I've manipulated an environment variable somewhere that I shouldn't have.
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
@Brever its endpointid/job-done/workerid and i have absolutely no idea what would cause this - I'm working backwards to work out what's happening.
Probably a missing dependency because everything else works. I've built against other runpod versions with the same issue so it's clearly my fault, but it's taking some time to work it out. Locally it works fine - making it even more awkward to figure out
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
I'm rebuild against RunPod 1.4.2 now because that was the last version I built that I know was working as I expect. So I can debug more easily.
I've made some changes to my container but not to the worker, so I'm surprised by the breakage. Currently assuming it's my error somewhere but why would that URL be a 404?
25 replies
RRunPod
•Created by RobB on 2/12/2024 in #⚡|serverless
Serverless - 404 cannot return results
I thought I had deleted its here (edit - on mobile, hard to do things)
25 replies
RRunPod
•Created by Phando on 2/7/2024 in #⚡|serverless
Docker image and SD Models
You'll also find a GitHub actions workflow in the .github directory. You can modify that to get auto builds when you push to the main branch of your fork
222 replies
RRunPod
•Created by Phando on 2/7/2024 in #⚡|serverless
Docker image and SD Models
Some of that is getting stripped out in the next update (tomorrow likely). Just remove anything related to rclone mount from the compose file as I'm dropping support completely.
I don't know anything about the blib-la repository. It's unrelated to my images and I have no experience building with docker on windows or Mac - I haven't used a windows desktop in many years.
The provisioning script is for installing nodes and pulling models at runtime - the models go to /workspace/storage and map back to the ComfyUI model directories so you don't have to re-download on every run. It has to be a publicly accessible URL but it has access to environment variables when it gets pulled into the container so you can have it download private assets
222 replies