Encyrption
RRunPod
•Created by Encyrption on 6/12/2024 in #⚡｜serverless
Can serverless endpoints make outbound TCP connections?
I know endpoints can make http/https requests but is there any limit on outbound connections? Is there a FW or are all ports open? What about bandwidth limitations, etc.? Thanks!
15 replies
RRunPod
•Created by Encyrption on 6/10/2024 in #⚡｜serverless
Anyone have example template for OpenVoice V2 serverless?
I would like to deploy https://github.com/myshell-ai/OpenVoice on serverless. It has a huggingface module can it be implement in the Serverless vLLM quick deploy? If so are there any instructions for doing so? If not what are my options for getting it installed?
11 replies
RRunPod
•Created by Encyrption on 6/8/2024 in #⚡｜serverless
CPU Instances on 64 / 128 vCPUs FAIL
I can deploy my app on all instances except for 64 & 128 vCPU. Both of these run on AMD EPYC 9754 128-Core Processor. When it tries to run it gets stuck in QUEUE with the error (pasted below). When this happens it then just loops between "start container" and "failed to create shim task: the file python was not found: unknown". Any ideas what is causing this and how to resolve? There is similar issue reported in pods section here but I am using serverless and getting same problem. ERROR from instance: error creating container: container: create: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.43/containers/03f5da1a67e9f72498f779b9923cb7927a703cc84d173fa038041e72a7caac9b/start": context deadline exceeded
19 replies