Anyone have example template for OpenVoice V2 serverless?
I would like to deploy https://github.com/myshell-ai/OpenVoice on serverless. It has a huggingface module can it be implement in the Serverless vLLM quick deploy? If so are there any instructions for doing so? If not what are my options for getting it installed?
GitHub
GitHub - myshell-ai/OpenVoice: Instant voice cloning by MyShell.
Instant voice cloning by MyShell. Contribute to myshell-ai/OpenVoice development by creating an account on GitHub.
Solution:Jump to solution
No, it's for vllm supported models only, it doesnt suport all types of pipeline
6 Replies
You would have to port it to serverless yourself.
Otherwise you can pay someone to do it for you.
Solution
No, it's for vllm supported models only, it doesnt suport all types of pipeline
But you can try making some image and templates for your use
vllm is for language models for that you would need to build own custom worker
I broke down and built an image for this. The OpenVoice V2 image is available on Docker Hub: https://hub.docker.com/repository/docker/drvpn/runpod_serverless_openvoice_worker and if you want to build from source: https://github.com/drvpn/runpod_serverless_openvoice_worker Is there a list of serverless workers out there?
GitHub
GitHub - drvpn/runpod_serverless_openvoice_worker: RunPod serverles...
RunPod serverless OpenVoice worker. Contribute to drvpn/runpod_serverless_openvoice_worker development by creating an account on GitHub.
No just search it
On google
Some may have lists on github