Postgres connection issue and sudden outage

ProjectID: 09bf07b8-3bc8-438d-8d8e-8e3b6d26d05a Service has been down for the last 2 days, have not seen any changes in usage. Looks like a database connection issue. And the database is extremely slow/spotty on the dashboard as well. Receiving the following error:
Can't reach database server at ...

Please make sure your database server is running at ...
Can't reach database server at ...

Please make sure your database server is running at ...
Have tried restarting the database, rotating db credentials and restarting the service - no luck. There is a sharp decrease in performance last couple of days from the DB. Since I have not made any changes or seen any increases in load, I'm assuming it's something on the railway end. Could you please take a look?
20 Replies
Percy
Percy2y ago
Project ID: 09bf07b8-3bc8-438d-8d8e-8e3b6d26d05a
Brody
Brody2y ago
would you happen to know when this database was originally created?
codico
codicoOP2y ago
I dont remember exact date, but a couple of months ago I believe
Brody
Brody2y ago
is the database slow/spotty when using pgadmin? (definitely don't rely on the data or query features built into the plugin)
codico
codicoOP2y ago
It does load in DBeaver, not super fast. But it does load. I believe I went live with this database in March, ~22nd
Brody
Brody2y ago
do you have a database backup?
codico
codicoOP2y ago
I do not have a backup at the moment
Brody
Brody2y ago
do you think you could dump your database as it stands right now?
codico
codicoOP2y ago
I can't create a backup dump for it super fast, but probably would be able to with enough time. I do not want to drop the database if that's what you mean
Brody
Brody2y ago
im suggesting dump your database and restore the data to a neon.tech database
codico
codicoOP2y ago
What is a neon.tech database? a separate service?
codico
codicoOP2y ago
I will look into it. But do you know why there are issues? I am a customer of Railway and am using Railway out of convenience, so I find it surprising to be suggested to use a separate service.
Brody
Brody2y ago
im just a community member, i dont know what has actually happened to your database, sorry. i don't enjoy suggesting another service for a database. but railway's database infrastructure is quite fragile to say the least, and even if the team did fix this for you there is no guarantee you wont face other database issues down the line
codico
codicoOP2y ago
Oh I see, thanks for letting me know.. I was under the impression you were a support engineer or part of the team! Yepp service is up after migrating off railway for the database, not a very good look :/ quite unfortunate. But thanks for the recommendation @Brody
Brody
Brody2y ago
oh i know its a terrible look, believe me
codico
codicoOP2y ago
Do you know how neon pricing looks? is it bad compared to railway?
Brody
Brody2y ago
haven't used neon myself yet so i dont know what the pricing is like, and even if i did i don't know what you do with your database, but ive seen lots of people recommend it
Ryan!
Ryan!2y ago
Subscribe I'm having a weird postgres issue too, where I can connect to the database but my app cant. Plus it one environment is fine, but my main one isn't booting because of this.
django.db.utils.OperationalError: connection to server at "containers-***.railway.app" (IP), port 6815 failed: Connection timed out
Is the server running on that host and accepting TCP/IP connections?
django.db.utils.OperationalError: connection to server at "containers-***.railway.app" (IP), port 6815 failed: Connection timed out
Is the server running on that host and accepting TCP/IP connections?
I also rebooted and rotated credentials.
codico
codicoOP2y ago
I'm still experiencing this issue even after migrating off of railway for the database. I can connect to the new database from outside raillway so unsure why the networking is having issues.
Want results from more Discord servers?
Add your server