Topics

RunPod•4w ago

Anyone have example template for OpenVoice V2 serverless?

I would like to deploy https://github.com/myshell-ai/OpenVoice on serverless. It has a huggingface module can it be implement in the Serverless vLLM quick deploy? If so are there any instructions for doing so? If not what are my options for getting it installed?

GitHub

GitHub - myshell-ai/OpenVoice: Instant voice cloning by MyShell.

Instant voice cloning by MyShell. Contribute to myshell-ai/OpenVoice development by creating an account on GitHub.

Solution:

No, it's for vllm supported models only, it doesnt suport all types of pipeline

Jump to solution

6 Replies

digigoblin•4w ago

You would have to port it to serverless yourself. Otherwise you can pay someone to do it for you.

Solution

nerdylive•4w ago

No, it's for vllm supported models only, it doesnt suport all types of pipeline

nerdylive•4w ago

But you can try making some image and templates for your use

Madiator2011•4w ago

vllm is for language models for that you would need to build own custom worker

Encyrption•4w ago

I broke down and built an image for this. The OpenVoice V2 image is available on Docker Hub: https://hub.docker.com/repository/docker/drvpn/runpod_serverless_openvoice_worker and if you want to build from source: https://github.com/drvpn/runpod_serverless_openvoice_worker Is there a list of serverless workers out there?

GitHub

GitHub - drvpn/runpod_serverless_openvoice_worker: RunPod serverles...

RunPod serverless OpenVoice worker. Contribute to drvpn/runpod_serverless_openvoice_worker development by creating an account on GitHub.

nerdylive•4w ago

No just search it On google Some may have lists on github

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

12KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

Custom Template with Jupyter not workingim trying to create a custom template that use jupyter, so im referencing the way jupyter installed Pod system errorI've been running this pod for over 6 months and suddenly it's having issues. Although it says the p What quantization for Cmdr+ using vLLM worker?I'm trying to set up these Cmdr+ models on serverless using the vllm worker but the only options I s Fast loading of large docker imageHello, I am trying to use a large docker image (>20GB) to start a pod. Is there a way to cache it i 0 gpu availablecurrently i can't assign a gpu to my pod. will i get the option to at a later point when some free u DATA LOSS IN EU-RO-1 - URGENTNeed someone to communicate ASAP this is literally sev0. We have all of our data and work backed in Clarify RAM availableHey there! Was thinking of using 4090 pods, and I saw that the deployment only had 60GB of RAM - whi Create CPU Pod through GraphQLThe API seems to expect a gpuTypeId even when you specify gpuCount: 0. Is there currently any way of How to add files?I just setup a pod for the first time and I am trying to ssh into it to add some custom model files.Very Slow MappingHello! I am trying to run `dataset.map()` and it takes only a few minutes when I run it on Colab. Ho