Justin
Explore posts from serversRRunPod
•Created by Justin on 2/17/2025 in #⚡｜serverless
Baking model into Dockerimage
If you want to bake a model into the container image you have to do it while building it. You can't do it afterwards without rebuilding it again, which can't be done on RunPod.Exactly thats what i mean, my first thought would simply be using vvlm as its building the neccessary fodler structure but i think you can just skip this by using --model and the local path with that you sent right? will test it out thanks ^^
6 replies
RRunPod
•Created by Justin on 2/17/2025 in #⚡｜serverless
Baking model into Dockerimage
wdym? I am not sure how i can prewarm vllm viwthout using vllm to download it as its doing more than just downloding it from huggingface. Im not sure if it needs more but im also unsure how exaxctly to do otherwise
6 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
So i am able to just ping it every now and then to wake it up and then have it warm up and ready right?
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
Ah okay
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
wdym
19 replies
RRunPod
•Created by testymctestface on 12/27/2024 in #⚡｜serverless
Running worker automatically once docker image has been pulled
Any chance to get in this beta? ❤️
63 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
any ETA for this?
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
Active Flashboot sounds amazing!
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
Woudlnt it, if its that same hardware and the same worker, still be able to do a warm start?
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
But even tho it has the same worker id it does the cold boot
19 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
Is there any specific time? because otherweise i could just send a requst every minute haha
19 replies
RRunPod
•Created by TristenHarr on 2/16/2025 in #⚡｜serverless
Why isn't RunPod reliable?
So i should send a support ticket you mean?
21 replies
RRunPod
•Created by Justin on 2/16/2025 in #⚡｜serverless
Flashboot not working after a while
I do not have any Active workers, Its simply one Worker who is idling
19 replies
RRunPod
•Created by blue whale on 2/11/2025 in #⚡｜serverless
Job stuck in queue and workers are sitting idle
My worker was booted up and was then in idle and the job is sometimes stuck for minutes
48 replies
RRunPod
•Created by blue whale on 2/11/2025 in #⚡｜serverless
Job stuck in queue and workers are sitting idle
+1
48 replies
RRunPod
•Created by TristenHarr on 2/16/2025 in #⚡｜serverless
Why isn't RunPod reliable?
But i am also still experiencing a lot of issues with the worker not actually starting even tho the queue is full or rather has one job in it, the worker is just idling
21 replies
RRunPod
•Created by TristenHarr on 2/16/2025 in #⚡｜serverless
Why isn't RunPod reliable?
I have switched to a different one and then it worked again
21 replies
RRunPod
•Created by TristenHarr on 2/16/2025 in #⚡｜serverless
Why isn't RunPod reliable?
I actually hada network volume on one of the DC's that had fulyl availability for h100 and it seems the reason why they are all available was that you cannot use any kind of workerso nthem as it will just continue to initialize
21 replies
RRunPod
•Created by 3WaD on 2/15/2025 in #⚡｜serverless
[Solved] EU-CZ Datacenter not visible in UI
Oh my bad haha
10 replies
RRunPod
•Created by 3WaD on 2/15/2025 in #⚡｜serverless
[Solved] EU-CZ Datacenter not visible in UI
10 replies