KJK

PostsComments

RRunPod

•Created by KJK on 2/14/2024 in #⛅｜pods

Stable Diffusion GPU Pod and API

Thanks Ashley. Even with active workers, I am getting 10 times the response time than what I get on GPU Pods. I'll look at the diffusers.

6 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

turn flash boot on

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

yes

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

I just found Flash Boot on the endpoint. Now starting almost immediately

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

Yeah, if you need it up 24 hours a day, that's $17.00 a day.

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

I don't know if there is another option -- but that could get costly if you have to keep it awake for long periods of time...

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

Update. The issue is starting cold. I adjusted the idle time to 30 seconds. After the first request, the next request only stayed in the queue for 163ms.

27 replies

RRunPod

•Created by Don on 2/12/2024 in #⚡｜serverless

automatic serverless api slow response problem

I am facing a similar issue. The request is stuck in the queue for well over a minute before it starts to process -- even when there is no other request. Any advice would be greatly appreciated.

27 replies