EngrBilal.
RRunPod
•Created by EngrBilal. on 7/16/2024 in #⚡｜serverless
Status "in-queue"
Hi! I am running my serverless endpoint in sync mode. Sometimes I get response like
{'delayTime': 85437, 'id': 'sync-822bbbf3-bae5-4efa-bbfa-9658ffda0175-u1', 'status': 'IN_PROGRESS'} or status in-queue.
1) why in sync mode it sends back in complete response?
2) how to get an actual completed response after I get the above response?14 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
Hi! I am new to docker and as well as to serverless. I would like to know what happens during cold start, does my image gets pulled again each time? Or it's just the time required for provising resources and loading models in vram etc?
32 replies