R
Railway•2y ago
sdan

Service is down

hi guys my service is down: https://railway.app/project/19be19f8-fe9a-438b-8425-b269d8c24d06/service/364380c7-b21a-4fde-9f86-ec63b19110e3?id=d3ecf291-3ff8-4c8c-99ff-8e90c8330bd2 it has been just hanging, i dont get any notification or indication whats up. any chance there is a diagnosis? this has been happening frequently on multiple apps want to figure out of this is user error or an issue on your end much thanks
Railway
404 - Page not found
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
37 Replies
Percy
Percy•2y ago
Project ID: 19be19f8-fe9a-438b-8425-b269d8c24d06,364380c7-b21a-4fde-9f86-ec63b19110e3,d3ecf291-3ff8-4c8c-99ff-8e90c8330bd2
Brody
Brody•2y ago
still shows successful in railway?
sdan
sdan•2y ago
but the logs stopped a while ago which is the issue -- silently stopped now its gone? getting a 404 on the project now 😯 for instance: http://chatwithwebsite.sdan.io/openapi.yaml this link should work. if it didn't it should show up in the logs. but logs stopped and now project is also gone.
Brody
Brody•2y ago
the project is gone???
sdan
sdan•2y ago
yep
Brody
Brody•2y ago
like the entire project just disappeared from your dashboard??
sdan
sdan•2y ago
i can click on it but it shows up 404 right after i messaged u here
sdan
sdan•2y ago
Railway
Railway
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
Brody
Brody•2y ago
and refreshing just continually gives you a 404?
gazhay
gazhay•2y ago
I'm getting 404 on my projects too
sdan
sdan•2y ago
yep just refreshed a dozen times
gazhay
gazhay•2y ago
6a6c4123-f4c9-4c41-ba5f-c3115ddc1753
Brody
Brody•2y ago
@Angelo - something not good is happening
sdan
sdan•2y ago
lmao now all my projects are pointing to 404 ill try logging in and out same thing
Brody
Brody•2y ago
#🚨|incidents
angelo
angelo•2y ago
calling incident reverting, thanks for catching @sdan
sdan
sdan•2y ago
thanks but my initial issue was one ive been having for the few weeks
angelo
angelo•2y ago
can you refresh my memory here, you mean on the intermittent 404s? or the deployment hangs
sdan
sdan•2y ago
Railway
404 - Page not found
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
sdan
sdan•2y ago
the logs stopped at 00:51 i want to figure out if this is my issue or issue on your end. i have similar services that have the same logging and are still streaming logs. but this service has stopped logging entirely
Brody
Brody•2y ago
how long ago was it deployed?
sdan
sdan•2y ago
this website powers https://chatwithweb-production.up.railway.app for instance but it doesn't seem to be running
sdan
sdan•2y ago
a day ago
Brody
Brody•2y ago
logging issues are definitely on their end
sdan
sdan•2y ago
my end?
Brody
Brody•2y ago
railways end
sdan
sdan•2y ago
alright i know i just brought this up a minute ago but any chance you guys can figure out if this is an actual issue? like logging or something else? i have to restart this service which runs for like an hour it seems and then stops. hoping to make sure this is an issue on my end before continuing notice the cpu usage for an hour and then drops? i am unsure if i am causing this... i am running a flask app
Brody
Brody•2y ago
your app stopping would be on you, loops like a soft lock from an out of heap error or something along those lines, but that's a big guess and if the logs stop when the service stops responding, that would no longer be railways fault either
angelo
angelo•2y ago
Yep- the logs is an us issue. I am going to flag it to Greg as its related to our clickhouse migration.
sdan
sdan•2y ago
heap error... is that a memory thing? i thought i get 16gb ram?
angelo
angelo•2y ago
Re: app, I have so much consternation with the Python runtime, you can run into heap errors even if there aren't container caps. One sec digging
Brody
Brody•2y ago
yep or gunicorn just silently stopping a worker if it's using too much mem
angelo
angelo•2y ago
8 GB of RAM fwiw How many workers are you running?
sdan
sdan•2y ago
just 1... could be the issue
angelo
angelo•2y ago
can you bump to 4
sdan
sdan•2y ago
cool will try, thanks angelo!
Brody
Brody•2y ago
maybe also worth looking into running gevent type workers seen lots of headaches from running sync workers
Want results from more Discord servers?
Add your server