Stewette
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
@BAS014 I tried switching it up by following runpod tutorials and running a 160gb serverless instance with attached network volume for a 70b model. I followed the official runpod tutorials.
It started up the instance without error, downloaded the model to the network volume, loaded it into memory, and then just... nothing.
A request stayed pending in the queue even though the worker was up and it didn't process it. I let it hang like that for about 5 minutes before just pulling the plug. I've tried other configurations, and even when I don't get an error message of any kind and the instance has enough memory, nothing happens.
I've been following official runpod tutorials the whole time. The service might be really spotty, but I've already been charged a few dollars just trying to follow the official docs, which is concerning.
25 replies