RichBoy

PostsComments

RRunPod

•Created by RichBoy on 11/4/2024 in #⚡｜serverless

Question about serverless vllm endpoint

I would like to deploy Qwen2VL-2B using vllm serverless. I know that It will create an endpoint that I can use to send a prompt. But I wonder if I could also send an image with prompt?

1 replies