Ale
RRunPod
•Created by Ale on 4/15/2025 in #⚡｜serverless
Serverless vLLM changing engine arguments
@Jason Thanks!
10 replies
RRunPod
•Created by Ale on 4/15/2025 in #⚡｜serverless
Serverless vLLM changing engine arguments
Created PR to add it back https://github.com/runpod-workers/worker-vllm/pull/177
10 replies
RRunPod
•Created by Ale on 4/15/2025 in #⚡｜serverless
Serverless vLLM changing engine arguments
@Jason https://github.com/runpod-workers/worker-vllm/issues/155 looks like support for it was implemented, and then someone accidentally removed it lol
Would it be possible to add it back again?
10 replies
RRunPod
•Created by Ale on 4/15/2025 in #⚡｜serverless
Serverless vLLM changing engine arguments
thanks I'll look into it and report back
10 replies