EngrBilal.
RRunPod
•Created by EngrBilal. on 7/16/2024 in #⚡｜serverless
Status "in-queue"
Sorry I got that wrong,it's /status endpoint and not the keyword
14 replies
RRunPod
•Created by EngrBilal. on 7/16/2024 in #⚡｜serverless
Status "in-queue"
How am I supposed to check status every second? Isn't it like the request response cycle gets completed after it sends me back status in progress ?
14 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
I checked on my docker hub, I can see how many times my image was being pulled
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
Image is being pulled on each cold start
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
30gbs of disk space
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
How to decide when to add model as part of docker image or download it on mounted drive
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
I am super confused now. Lol
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
Cool. Thanks for answers
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
What's the path of mounted drive?
32 replies
RRunPod
•Created by EngrBilal. on 7/11/2024 in #⚡｜serverless
What happens during cold start time?
Awesome. I have another question. I have model weights of 30gbs. Do you recommend adding them in docker image or I should download them using a script to mounted volume?
32 replies