teddycatsdomino
teddycatsdomino
PostsComments
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
You might be missing a dependency for the Impact Pack.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
You can see the log when Comfy starts up, it should list the installed custom nodes, how long it to import them, and whether or not any failed. Something like this: 
2024-09-19 11:13:18 Import times for custom nodes:
2024-09-19 11:13:18    0.0 seconds: /workspace/ComfyUI/custom_nodes/websocket_image_save.py
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_UltimateSDUpscale
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_essentials
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Fal-API-Flux
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-KJNodes
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Inspire-Pack
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
2024-09-19 11:13:18    0.6 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
2024-09-19 11:13:18    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Impact-Pack
2024-09-19 11:13:18    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-SAM2
2024-09-19 11:13:18    1.4 seconds: /workspace/ComfyUI/custom_nodes/was-node-suite-comfyui
2024-09-19 11:13:18    1.4 seconds: /workspace/ComfyUI/custom_nodes/eden_comfy_pipelines
2024-09-19 11:13:18   52.5 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-3D-Pack
2024-09-19 11:13:18 Import times for custom nodes:
2024-09-19 11:13:18    0.0 seconds: /workspace/ComfyUI/custom_nodes/websocket_image_save.py
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_UltimateSDUpscale
2024-09-19 11:13:18    0.1 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI_essentials
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Fal-API-Flux
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-KJNodes
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Inspire-Pack
2024-09-19 11:13:18    0.2 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Manager
2024-09-19 11:13:18    0.6 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-VideoHelperSuite
2024-09-19 11:13:18    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-Impact-Pack
2024-09-19 11:13:18    0.7 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-SAM2
2024-09-19 11:13:18    1.4 seconds: /workspace/ComfyUI/custom_nodes/was-node-suite-comfyui
2024-09-19 11:13:18    1.4 seconds: /workspace/ComfyUI/custom_nodes/eden_comfy_pipelines
2024-09-19 11:13:18   52.5 seconds: /workspace/ComfyUI/custom_nodes/ComfyUI-3D-Pack
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
I think you missed the ComfyUI Impact Pack
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
Make sure you've installed all your custom nodes.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
Disable your preview nodes when you save out the API format.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
With enough vram maybe you could pull it off, but that's not really a Comfy problem in either case right? I'd just create multiple endpoints.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
I haven't tried it yet but theres also this node: https://github.com/willblaschko/ComfyUI-Unload-Models
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
https://github.com/comfyanonymous/ComfyUI/pull/3605
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
There's also a PR that was never included which lets you cache multiple models so that changing between them doesn't reload them.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
If you're booting Comfy every time you process a new workload it'll be rough.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
@Encyrption I'm assuming you're already keeping the Comfy server running right? Comfy has some model management built in, but there are also custom nodes that 'might' help. As long as the server is running and you don't change the model, successive runs should be MUCH faster. You can see this just by restarting a server, loading comfy, running a workflow, changing an input and running it again.
197 replies
RRunPod
Created by teddycatsdomino on 9/19/2024 in #⚡｜serverless
Possible to provision network volume programmatically?
Great, thank you Flash!
3 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
You can keep Comfy warm and it does some auto caching as long as you have an endpoint for each type of workload defined.
197 replies
RRunPod
Created by fawkes on 9/18/2024 in #⚡｜serverless
How to set up runpod-worker-comfy with custom nodes and models
@Encyrption Depending on what you're doing, you may find it easier to change the way Comfy loads models than to rework your entire solution.
197 replies
RRunPod
Created by teddycatsdomino on 8/11/2024 in #⚡｜serverless
Runpod serverless overhead/slow
Thank you @flash-singh! This is working very well.
185 replies
RRunPod
Created by nerdylive on 8/14/2024 in #⚡｜serverless
Why it seems like my job isn't assigned to a worker ( even after refreshing)
Of course. I honestly didn't even notice until @nerdylive posted about it! I may try his suggestion of setting the scaling type to "Request Count" with a maximum of one request to see if it does better.
43 replies
RRunPod
Created by nerdylive on 8/14/2024 in #⚡｜serverless
Why it seems like my job isn't assigned to a worker ( even after refreshing)
For us that's unfortunately not a great option. We're processing video and our tasks run for 10-20 minutes. We don't want someone to be waiting for that long when there's an available worker.
43 replies
RRunPod
Created by nerdylive on 8/14/2024 in #⚡｜serverless
Why it seems like my job isn't assigned to a worker ( even after refreshing)
@Tim aka NERDDISCO Let me know if you need any other information.
43 replies
RRunPod
Created by nerdylive on 8/14/2024 in #⚡｜serverless
Why it seems like my job isn't assigned to a worker ( even after refreshing)
No description
43 replies
RRunPod
Created by nerdylive on 8/14/2024 in #⚡｜serverless
Why it seems like my job isn't assigned to a worker ( even after refreshing)
No description
43 replies