panos.firbas
Disk reading unacceptably and mind boggingly slow
Same problem today
RunPod Pytorch 2.1
ID: 5vzts37ixeqaz7
1 x A100 80GB
8 vCPU 188 GB RAM
runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04
On-Demand - Secure Cloud
My data is in /scratch
and the script that just reads records from the database one by one works at 2 iterations/second.
On a computer where the .db is read from an SSD this runs at 600 iterations/second.
So i'm pretty sure there's pods where even / is on the network ?
6 replies
Disk reading unacceptably and mind boggingly slow
Hi Justin, I'm pretty sure I am that someone since I remember chatting with you!
And the problem is that yesterday even though I copied my data to the container disk area ( at the root of the filesystem if I'm not very mistaken: "/" ), the reading was just as slow as from the network disk.!!
6 replies