uhmm i think i filled the entire disk somehow
service id: 66b587c8-3c50-4dd0-8dfa-394ade04a0ec
Solution:Jump to solution
Hi @ThallesComH,
We unfortunately had an issue with the daemon on that host when it ran out of disk space and this triggered a race condition where the daemon tried to restart the database and ended up deleting the containers metadata. We restored a database backup, but this is from 1.5 hours before it crashed. I created a new database in your project with the data (https://railway.app/project/66b587c8-3c50-4dd0-8dfa-394ade04a0ec/plugin/b3315978-d437-409a-a373-c6d65b323740/Data). Feel free to remove the old one.
We may potentially be able to restore a more recent version if this is required. But this might take a few more days. I've also credited your account for any inconvenience this may have caused....
11 Replies
Project ID:
66b587c8-3c50-4dd0-8dfa-394ade04a0ecThread has been flagged to Railway team by @Vin.
you filled 32gb?
<@818959779326197841> has multiple active tickets. Please close them before opening a new one.
Go away Percy!
You don't need to worry about that
yeah dutchess would still send the ticket to plain
ohh this is the first time i see the new bot doing something
It's for more internal thingamabobs, but Ray asked us to use it for tagging the team
Solution
Hi @ThallesComH,
We unfortunately had an issue with the daemon on that host when it ran out of disk space and this triggered a race condition where the daemon tried to restart the database and ended up deleting the containers metadata. We restored a database backup, but this is from 1.5 hours before it crashed. I created a new database in your project with the data (https://railway.app/project/66b587c8-3c50-4dd0-8dfa-394ade04a0ec/plugin/b3315978-d437-409a-a373-c6d65b323740/Data). Feel free to remove the old one.
We may potentially be able to restore a more recent version if this is required. But this might take a few more days. I've also credited your account for any inconvenience this may have caused.
Hi, no problem, all data in that database is pulled from an API and that's why i had no backup system in there.
thanks for the help
Awesome. Again, sorry about this. We are taking steps to ensure this never happens