Logs are missing.
I'm trying to get the error logs on prediction but all I see are the model loading/downloading while building the docker. How can I get the logs for inference to debug?
7 Replies
Click the logs tab on your endpoint.
that seems to be missing logs quite often
Yeah if your logs are too verbose, they get dropped
no way to fix that?
Nope unfortunately not, RunPod designed it like that for some reason. Perhaps @flash-singh can provide some further input.
another question, Im trying to save an image that is being sent for inference, and then read it later. But I get an error that says it cant find the image. Do you have any idea why that is?
You have to use network storage if you want to persist data across all of your workers/use the data later. The container disk is temporary and the data gets lost when the container stops.