reavatar
Explore posts from serversRRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
Using it create labels eg. True/False and want to pick highest prob labels and also have a kind of system where I need to verify if a particular response was generated from a model or not. I think I'd just switch to Modal for now.
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
Any ETA?
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
By the way, this doesn't return logprobs even when passed in sampling params
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
worked. Thanks
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
ok, downloading now
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
error pulling image: Error response from daemon: manifest for alpayariyak/vllm:11.8 not found: manifest unknown: manifest unknown27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
Also, thought to build docker image on runpod gpu, but docker wasn't starting there
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
It crash my 32GB RAM while running setup.py vllm
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
I previously had cloned till below commit and was working.
https://github.com/runpod-workers/worker-vllm/tree/24feadd903cf5528b3e5ec8ce400fd6a184ecc04
Now, when using this commit
is causing trouble. If this could be worked out, I'd atleast having something working for now
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
40 minutes
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
This is same command listed on Readme docs
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
With username/image:tag ofcourse my own
27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
sudo docker build -t username/image:tag --build-arg MODEL_NAME="openchat/openchat_3.5" --build-arg MODEL_BASE_PATH="/models" .27 replies
RRunPod
•Created by reavatar on 12/18/2023 in #⚡｜serverless
Download Stuck - Worker VLLM
This has started happening with new worker vllm changes and wasn't happening earlier
27 replies
CDCloudflare Developers
•Created by reavatar on 7/15/2023 in #pages-discussions
Clerk sign out issue with next.js
Thanks you much. I'll try it out with next package release.
10 replies
CDCloudflare Developers
•Created by reavatar on 7/15/2023 in #pages-discussions
Clerk sign out issue with next.js
Found out a workaround: Started using router push to point to signin url instead of same url.
10 replies
CDCloudflare Developers
•Created by reavatar on 7/15/2023 in #pages-discussions
Clerk sign out issue with next.js
Though in every case, signout does happens. It's just that I have to manually press reload to get back to signin screen.
10 replies
CDCloudflare Developers
•Created by reavatar on 7/15/2023 in #pages-discussions
Clerk sign out issue with next.js
couldn't find any workaround or solution for visiting same page after signout
10 replies
CDCloudflare Developers
•Created by reavatar on 7/15/2023 in #pages-discussions
Clerk sign out issue with next.js
I found out the problem only occurs when I route back to same page after signout.
It works fine when using router.push to a different page after signout
10 replies