Is there any serverless template, or vLLM compatible HF repo for Vision models?
Hi!
Are there any plug and play LLAVA serverless templates, or LLAMA 3 (or other) vision models that work with Runpod vLLM?
I was using Ashleyk's awesome runpod-worker-llava, but it has been removed since.
1 Reply
GitHub
GitHub - jrcastropy/runpod-worker-llava: LLaVA: Large Language and ...
LLaVA: Large Language and Vision Assistant | RunPod Serverless Worker - jrcastropy/runpod-worker-llava