Serverless SD concurrent requests on multiple checkpoints
Hi,
Do you know if there is a way to handle concurrent SD predictions (even 10 is fine) on different checkpoint with different prompt?
For example I want to run 5 concurrent requests on checkpoint_1 and 5 on checkpoint_2, passing the checkpoint name in the request body.
Thank you
3 Replies
Hey
Try using serverless a1111
Set the max workers to 10 then so it can run together
And set the queue delay to 1
ComfyUI has much faster slow start times, is more flexible and produces better results than A1111. I use this one - https://github.com/ashleykleynhans/runpod-worker-comfyui
GitHub
GitHub - ashleykleynhans/runpod-worker-comfyui: RunPod Serverless W...
RunPod Serverless Worker for the ComfyUI Stable Diffusion API - ashleykleynhans/runpod-worker-comfyui
Oh yeah this works too
How does it produces better results?