yarcat
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
I'd like to understand that pricing a bit. I have two serverless instances, each of them has 1 active worker:
1. vllm-4t9gk2df0h0pds runs 2xA40 2x0.0002*60*60*24=34.56 $/day
2. vllm-2513y3iyxauhz2 runs 4xA40 4x0.0002*60*60*24=69.12 $/day
Which gives us around 104 $/day
Both instances use 50GB local disk storage (as it was recommend above).
However, my dashboard shows 123+$/day for exactly this setup, and at some point it was above 200 $/day, when we accidentally configured 200GB disk space per instance
I'd like to understand, if there is a way for me to optimize it. 160+ $/day is kinda over my budget. And I'm trying to understand how did it happen that my deprecating on demand instances in favor of serverless, I actually started to pay more.
79 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
Thanks!!!
79 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
I'm using this endpoint for almost a month, and it never behaved like that. Over the last few days I've noticed it was restarting kinda noticably frequently. But today it is just horrible.
79 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
Sorry for the delay replying. I've cloned the pod, as pointed out above. No issues since then
79 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
absolutely, sorry I didn't do it this time
79 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡｜serverless
Stuck in the initialization
I've cloned my endpoint and deleted the original one. The cloned one seems to work just fine.
79 replies