Topics

RunPod•3mo ago

I wanna use comfyUI for a img2vid workflow - can I do this via the serverless service

I already tried setting up a pod yesterday where I uploaded all the needed models and stuff but today I cannot use it anymore since there are no GPUs that I can use. I also have everything set up locally and so the idea is to just use the GPUs via the serverless option. But I have no idea how this works and what is my best way forward?

2 Replies

agentpietrucha•3mo ago

Are you having trouble writing handler function for serverless in overall? Or you know how to write the handler, but you are having problems with your img2vid workflow?

nerdylive•3mo ago

You want to run your serverless handler locally?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

12KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

Using network volume with serverlessI am running a stateless model within serverless to modify provided image. I am wondering if the net Python modules missing when pod is startingWhen starting a comfy-ui pod after some downtime, I get a lot of messages of the kind ``` Import t How to convert a template to serverless?Hi, I've been using Runpod for a while, I have a lot of templates for serverless inference. However,How do I handle both streaming and non-streaming request in a serverless pod?How can I handle both effectively? Is it okay to have a handler witht both yield and return? i.e. ``Runpod doesn't work with GCP artifact registyrRunpod doesn't work with GCP artifact registry. I even copied the complete json key and added it as Memory usage on serverless too highI finally managed to get the serverless setup working. I just sent a very simple post with a mini