leduyson2603
RRunPod
•Created by leduyson2603 on 2/12/2025 in #⛅｜pods-clusters
VLLM problem in A100 instance
Hi everyone, right now i'm having problem when trying to deploy runpod into A100 instances. I have tried many of A100 in different region but it always showing error "OSError: [Errno 98] Address already in use". I'm using VLLM version 0.6.3post1, it works fine for the last month but recently it not work anymore and if i deploy to another instance like A40 or RTX6000, it just works fine. Does anyone know the problem?
3 replies
RRunPod
•Created by leduyson2603 on 8/14/2024 in #⛅｜pods-clusters
Weird error when deploy lorax inference server
2 replies
RRunPod
•Created by leduyson2603 on 4/16/2024 in #⚡｜serverless
Runpod return {'error': 'request does not exist'}
I'm using stable-diffusion-forge template. I have sent requests to runpod using /run endpoint and /status endpoint for retrieving the status. Everything work normally until today when im checking the error log, it shows {'error': 'request does not exist'} when sending the /status. I think the error above is from runpod webserver. Can anyone explain about this?
21 replies
RRunPod
•Created by leduyson2603 on 4/11/2024 in #⚡｜serverless
Limited choice for network volume region
7 replies
RRunPod
•Created by leduyson2603 on 2/29/2024 in #⚡｜serverless
Runpod worker automatic1111 just respond COMPLETED and not return anything
50 replies