Complete Postgres downtime since 1.5h ago

My application (https://status.updown.io) has been down for 1.5h Looking at the logs it looks like the Postgres database is not reachable any more (timeout): PG::ConnectionBad (connection to server at "containers-us-west-33.railway.app" (34.83.146.117), port 7540 failed: Connection timed out I tried restarting the app and the database from the UI, to no avail. I also don't see any downtime declared on the status page so I'm reaching out to let you know there's a problem. Thanks, Adrien
36 Replies
Percy
Percy14mo ago
Project ID: e1f34396-30a0-4461-8e9b-da02f79d457f
BigBourin
BigBourinOP14mo ago
e1f34396-30a0-4461-8e9b-da02f79d457f
Fragly
Fragly14mo ago
Seems to be an issue on railway's side, there's other reports of this in this help channel
jr
jr14mo ago
Everything should be back to normal now
JustJake
JustJake14mo ago
We've conducted a full post mortem on the platform side here. Posted it at https://discord.com/channels/713503345364697088/846875565357006878/1162544323942948875 Once again, apologies for this and we're available if you've got any questions!
BigBourin
BigBourinOP14mo ago
I saw it on the status page thanks (though I don't really like that it says "Resolved after 37 minutes" simply because it was started 1.5h late). So how do we migrate to Service + Volume ?
BigBourin
BigBourinOP14mo ago
I read in another thread that it should be https://railway.app/template/postgres (and then dump + restore), so I tried to add this template but it fails with:
No description
BigBourin
BigBourinOP14mo ago
I don't understand why it asks for a Github account, and also why it fails if I already have my github account connected I also tried Ctrl + / and then "Provision PostgreSQL", but this seems to create a v1 integration? (I don't see any difference with my current one, and I don't see any attached volume). Is this service + volume thing really the new default?
Brody
Brody14mo ago
databases as services (databases v2) are the default for users on beta, I think for non beta users to deploy the database services you need to do + New > Template > PostgresSQL (from within a project) as for that github error I have no clue, but try that flow I just spoke of
BigBourin
BigBourinOP14mo ago
Thanks, unfortunately I also tried this yes, and it asks me for Github too:
No description
BigBourin
BigBourinOP14mo ago
If I click this I'm back to the error message before :/
Brody
Brody14mo ago
what does the account integrations section here say? https://railway.app/account
BigBourin
BigBourinOP14mo ago
Says I'm not connected:
No description
BigBourin
BigBourinOP14mo ago
And same error if I try to. Maybe I did at some point in the past but the integration got broken in the meantime
Brody
Brody14mo ago
do you have another railway account?
BigBourin
BigBourinOP14mo ago
Though I'm not sure why I should connect my Github to create a database :/ No I don't have another account
Brody
Brody14mo ago
have you ever had two (or more) accounts?
BigBourin
BigBourinOP14mo ago
I'm not sure but it's possible I had a personnal before that I deleted, I'll try finding and removing the integration on Github side maybe
Brody
Brody14mo ago
alright let me know how that goes
BigBourin
BigBourinOP14mo ago
Ok now it says "This GitHub account has previously been connected to a different Railway account. Please use that account or delete it in order to use this GitHub account with the current Railway account."
Brody
Brody14mo ago
and the only problem being you lost access to that account
BigBourin
BigBourinOP14mo ago
Well as I removed the credentials from my password manager I'm pretty sure I deleted that account if it ever existed, but ok I'll try some password recovery to see if I can find it back But why do I even need Github here? Are you requiring Github for anything?
Brody
Brody14mo ago
i assume its some left over verification code, code that shouldnt be needed when on the hobby plan so yeah you are right, you are on the hobby plan and you are trying to deploy a docker image, you shouldnt need a github account for this but it is what it is right now so just try to remove the github account from your previous railway account
BigBourin
BigBourinOP14mo ago
Ok I found the previous account, and also the reason why it wasn't in my password manager (because you're using this annoying Magic login stuff which makes it harder to login). I deleted it now. Now I can connect to Github, but it REQUIRES me to "Install" the Github application by giving it acces to at least 1 repository...
Brody
Brody14mo ago
im not using anything, i dont work for railway 🙂
BigBourin
BigBourinOP14mo ago
Ok ^^
Brody
Brody14mo ago
yep, go ahead and do that
BigBourin
BigBourinOP14mo ago
Well then thanks for your help Lol no I'm not, I'm not gonna give Railway access to my repository just so I can fix their database issue
Brody
Brody14mo ago
just make a empty repo or something lol
BigBourin
BigBourinOP14mo ago
Sure, all the more work just to please this stupid decision
Brody
Brody14mo ago
chill
BigBourin
BigBourinOP14mo ago
No unfortunately I was willing to give Railway one more chance if it wasn't too hard but this is getting way too unprofessional and unreliable for my use-case so I think I'll move this project again to another host of mine and be done with it. But thanks for your help 👍
Brody
Brody14mo ago
okay then
BigBourin
BigBourinOP14mo ago
For the record, I just tried creating one of the new Postgres template before leaving to see if there was more problems ahead, and I wasn't able to create it in the same project, even if added from the project, it creates another empty project. Which would make it much harder to migrate. Is that expected ? is this migration actually possible ?
Brody
Brody14mo ago
it is absolutely possible, I have done it countless times, so I'm not too sure what was done when you tried to deploy it
BigBourin
BigBourinOP14mo ago
Ok thanks
Want results from more Discord servers?
Add your server