VLLM problem in A100 instance
Hi everyone, right now i'm having problem when trying to deploy runpod into A100 instances. I have tried many of A100 in different region but it always showing error "OSError: [Errno 98] Address already in use". I'm using VLLM version 0.6.3post1, it works fine for the last month but recently it not work anymore and if i deploy to another instance like A40 or RTX6000, it just works fine. Does anyone know the problem?
1 Reply
Maybe something else is runnign in that port, check the program running in that port