CPU seems extremely slow
Hello, I created a pod with an A40 and 16vCPU. I'm trying to train a deep learning model, however, I'm stuck at data preprocessing as the CPU seems to be very slow, this step takes 10 times longer than on my computer with an i5 13th gen which seems very surprising to me.
The CPU usage is 100% on the dashboard when I run this step, which is as well surprising.
8 Replies
Wow 10 times longer?
What template do you use?
You sure the running tasks or processes are the same?
i'm using the vs code server, the tasks I perform are mainly storing the data in arrays and resizing image data
I just compared the execution of a jupyter notebook cell running this preprocessing on my computer and on runpod
Thought im the only one having this issue. My local machine with lower spec can run faster than the pod i deployed in runpod. Few months ago i run the same script and it was fine. This week when i tried to run it becomes slow. As if the process was running on cpu instead of gpu
GPU seems to run fine although not particularly fast but I suspect that it is slowed by some CPU operations during training, the issue is really with CPU processes
Yeah2 thats right. When running the script i saw my GPU was in used but the process is veerrrry slowww
It such a waste of money to keep on testing from one pod to another just to see which pod is better
You guys got pod ids that you use?
can ask support about your pods
It has been 2 days trying to reach out to live chat support
Still no one answering
Keep saying the agent is offline
Try emails
I think there's some trouble in live webchat