Serverless is Broken
Something is clearly broken. Delay times are around 2 mins even when the same worker is getting a request in a row, it still takes 2 mins. It's not a cold start issue because even my normal cold starts don't take longer than 15 seconds.
2 Replies
does it download models?
whats taking so long there, can you add some timers, or prints to see which process takes long
@nerdylive no it doesn't download anything or install anythin since everything is embeded in docker image. Now things get back to normal . I dont think adding logging will help since issue is container is not being running.