Upgrading VLLM to v0.6.0

I was wondering what the process would be to upgrade the serverless worker code to be compatible with the latest version of VLLM.
1 Reply
nerdylive
nerdylive4mo ago
Check out the github repo and check the commits which they used to release newer version

Did you find this page helpful?