Upgrading VLLM to v0.6.0

I was wondering what the process would be to upgrade the serverless worker code to be compatible with the latest version of VLLM.
1 Reply
nerdylive
nerdylive3mo ago
Check out the github repo and check the commits which they used to release newer version
Want results from more Discord servers?
Add your server