Docker Image EXTREMELY Slow to load on endpoint but blazing locally
This is the first time I'm encountering this issue with the serverless EP
I've got a docker image, which loads the model (flux schnell) very fast, and it runs a job fairly fast on my local machine with a 4090.
When I use a 4090 in RP though, the image gets stuck at loading the model
This can take like 5mn ... which is 1) humongous and 2) not doable in production.
What could be causing this ?
1 Reply
my bad I was using runpod_volume on this one ....... making it super slow Removed it and it works