haris
Explore posts from serversRRunPod
•Created by nerdylive on 7/2/2024 in #⚡|serverless
Bug in runpodctl project?
cc: @nathaniel
3 replies
RRunPod
•Created by octopus on 6/25/2024 in #⚡|serverless
Distributing model across multiple GPUs using vLLM
cc: @Alpay Ariyak
10 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡|serverless
Stuck in the initialization
No worries!
12 replies
RRunPod
•Created by Stone Johnson on 6/23/2024 in #⚡|serverless
Is there an equivalent of flash boot for CPU-only serverless?
Sorry, I more so meant how are you using the CPUs so we have a better understanding of why it takes six seconds to cold boot
23 replies
RRunPod
•Created by Stone Johnson on 6/23/2024 in #⚡|serverless
Is there an equivalent of flash boot for CPU-only serverless?
@Stone Johnson what's your workload?
23 replies
RRunPod
•Created by yarcat on 6/24/2024 in #⚡|serverless
Stuck in the initialization
@yarcat In the future would you be able to provide an endpoint ID so we could investigate further
12 replies
RRunPod
•Created by shockz on 6/24/2024 in #⚡|serverless
How does the soft check on workers limit work?
The soft limit just checks your balance at the time of the upgrade, if you do fall below that balance at another time you will not lose access to the upgraded workers count.
15 replies
RRunPod
•Created by digigoblin on 6/14/2024 in #⚡|serverless
Intermittent connection timeouts to api.runpod.ai
cc: @Satish
15 replies
RRunPod
•Created by shensmobile on 6/13/2024 in #⚡|serverless
vLLM streaming ends prematurely
cc: @Alpay Ariyak
45 replies
RRunPod
•Created by fireice on 6/13/2024 in #⚡|serverless
Why no gpu in canada data center today?
Yep, as far as I know but I will double check
25 replies
RRunPod
•Created by octopus on 6/11/2024 in #⚡|serverless
Cannot run Cmdr+ on serverless, CohereForCausalLM not supported
cc: @octopus
8 replies
RRunPod
•Created by fireice on 6/13/2024 in #⚡|serverless
Why no gpu in canada data center today?
Hey y'all, we disable the creation of new pods four days before a maintenance to stop further issues (this was not something I was personally aware of until now otherwise it would have been posted in #🚨|incidents). However, I talked with the team and you should be able to create new pods again, let me know if you're running into any issues.
25 replies
RRunPod
•Created by li.haoyu on 6/13/2024 in #⚡|serverless
Backup plan for serverless network outage
Are you able to DM me your RunPod email as well as endpoint ID?
15 replies
RRunPod
•Created by li.haoyu on 6/13/2024 in #⚡|serverless
Backup plan for serverless network outage
Do you have a network storage attached?
15 replies
RRunPod
•Created by octopus on 6/11/2024 in #⚡|serverless
Cannot run Cmdr+ on serverless, CohereForCausalLM not supported
cc: @Alpay Ariyak
8 replies