rewbs
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
No worries, this is not an easy problem. EGL is a software layer above OpenGL which supports headless rendering.
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
Oh. Which software are you referring to though? My code? (there are many layers of software in play here 🙂 )
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
The hardware is definitely there and supported. 🙂 My serverless endpoint kicks off 2 concurrent processes on the same serverless worker: one surfaceless ELG task (similar to the example codebase above), which fails to detect and use the Nvidia GPU, and one "standard" python ML process, which does find and use the Nvidia GPU.
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
If you figure it out please report back! I wonder if it's something to do with the privileges made available to docker containers in Runpod vs locally.
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
Hey, nope – still can't get it to run on GPU. I'm resorting to running this process in parallel to other tasks (that do use the GPU) within the same serverless invocation! 🙂
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
Wow that looks like an impressive piece of work. Am I right in thinking your image re-installs the driver on every startup? If so I assume it's designed for a long-running pod rather than serverless tasks – and probably won't be sensible for my serverless usecase where a job execution would typically be under 30s.
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
Thanks so much, will take a look
26 replies
RRunPod
•Created by rewbs on 3/22/2024 in #⚡｜serverless
Docker image using headless OpenGL (EGL, surfaceless plaform) OK locally, fails to CPU in Runpod
An old-school audio-visualisation renderer (I'm the author of https://vizrecord.app/ which is client side – from there you can probably guess what I'm building 🙂 ).
26 replies
RRunPod
•Created by rewbs on 2/14/2024 in #⚡｜serverless
Is there a way to access worker ID & job ID from a handler? Would be good for logging + debugging
Thanks both!!
6 replies
RRunPod
•Created by rewbs on 12/21/2023 in #⚡｜serverless
Jobs suddenly queuing up: only 1 worker active, 9 jobs queued
No network volume
5 replies
RRunPod
•Created by rewbs on 12/21/2023 in #⚡｜serverless
Jobs suddenly queuing up: only 1 worker active, 9 jobs queued
5 replies