Losing all important data in /workspace folder while pod is running :(
I am running a pod with A100 SXM 80G and an attached workspace. But suddenly I lost every content in the /workspace folder while maintaining the connection. I have very important data in the workspace that I am working on. Could any staff member kindly look into how this happens?
12 Replies
Could you provide more information?
Are you using network storage? Volume storage?
Yea sure, I am using volume storage with 500GB
Is it ok for me to share my pod id here?
I checked the log but seems nothing suspicious
i have the smae issue, i store all data on /workspace directory and use volume storage with 150 GB and suddenly all the data are removed and the gpt type changed to rtx 3090 when i was still connecting to that pod, even the program are running on it
This is not possible, you did something wrong.
actually that's true, just check my previous history it chould be found that i rent A5000 on the same pod
but suddenly it change to rtx 3090 with the same pod id and all my data lost
😦
what is pod id
u mean u wanna me to provide that pod id to u ?
I can check what might be going on
i will send it to u
so what I see that pod is on RTX 3090 host machine
community cloud host
yes
but before that Friday it is A5000
when i rent it
but suddenly stop and change to rtx 3090
at 11:59 pm according to the audit log history, when i connect again, it becomt rtx 3090 and all the data lost
may you also send email you use on runpod account