abid7001
RRunPod
•Created by MaxHager on 8/10/2024 in #⚡｜serverless
Confusion with IDLE time
I just went to Runpod serverless then tried to use microsoft/Phi-3.5-mini-instruct from huggingface, but shortly after its says its read it will stop like ex below:
2024-09-26T06:52:26Z Status: Image is up to date for runpod/worker-v1-vllm:v1.4.0stable-cuda12.1.0
2024-09-26T06:52:26Z worker is ready
2024-09-26T06:52:26Z start container
2024-09-26T06:55:35Z stop container
2024-09-26T06:55:37Z remove container
19 replies
RRunPod
•Created by MaxHager on 8/10/2024 in #⚡｜serverless
Confusion with IDLE time
hello guys, I hope you are all doing well, may you please help me with a question as I am new to Runpod, I have been trying for last few days to deploy an llm from huggingface on Runpod but every time shortly after deployment runpod will automatically remove the container, may anyone please assist me on what I am doing wrong
19 replies