DEVIL_EGOX
RRunPod
•Created by DEVIL_EGOX on 2/4/2025 in #⚡｜serverless
Deployed deepseek-ai/DeepSeek-R1-Distill-Llama-8B on Serverless
Has anyone deployed deepseek-ai/DeepSeek-R1-Distill-Llama-8B on Serverless? I have loaded it but it answers infinitely. 😅
2 replies
RRunPod
•Created by DEVIL_EGOX on 12/5/2024 in #⚡｜serverless
vllm +openwebui
Hi guys, has anyone used Vllm as endpoint in OpenWebUI? I have created a serverless pod but it does not let me connect from openwebui (loaded locally). Does anyone know if I have to configure the external port and how it would be?
44 replies