Lattus
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
Thanks for your help
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
hmm.. I see
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
I thought it could be more cost effective to just run a serverless endpoint here but..
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
I mean, Deepseek offers their own API keys
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
so it's not really an option to deploy?..
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
wow
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
So how do I configure ?
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
""Uncaught exception | <class 'torch.OutOfMemoryError'>; CUDA out of memory. Tried to allocate 3.50 GiB. GPU 0 has a total capacity of 44.45 GiB of which 1.42 GiB is free"
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
When I tried running the larger model, I got errors about not enough memory
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
yes, but I tried even just following along with the youtube tutorial here and got the same IN_QUEUE problem...: https://youtu.be/0XXKK82LwWk?si=ZDCu_YV39Eb5Fn8A
41 replies
RRunPod
•Created by James on 1/21/2025 in #⚡｜serverless
Can not get a single endpoint to start
Lol, I'm having the same problem
5 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
Once it is running, I try the default hello world request and it just gets stuck IN_QUEUE for 8 minutes..
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
41 replies
RRunPod
•Created by Lattus on 1/22/2025 in #⚡｜serverless
Serverless deepseek-ai/DeepSeek-R1 setup?
https://huggingface.co/deepseek-ai/DeepSeek-R1
It seems so.
41 replies