Some logs never load
Some instances I can see logs, this one it loads forever https://railway.app/project/2735e0d8-8458-46b3-8998-56ab1d1c4646/logs?filter=%40deployment%3A0b22e706-dea1-442f-ae72-45d81ce1ae7e
Railway
Log Explorer
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
87 Replies
Project ID:
2735e0d8-8458-46b3-8998-56ab1d1c4646,0b22e706-dea1-442f-ae72-45d81ce1ae7eI tried hard refreshing the browser and all that
Service is online and working but I have no log observability
Could you try redeploying?
if redeploying doesn't solve the issue then make sure you're sending unbuffered data to stdout
I'm not seeing how to redeploy from web nor can I rollback if something goes wrong
@Fragly It's a legacy service so I don't really want to deploy from code unless I need to
What does unbuffered mean here? I'm using logrus with Go to stdout, stderr
Oh nevermind, if the issue is from a railway database then buffered stdout is not the issue
nevermind i'm tweaking
Haha
fr
you should be able to rollback old deployments
Can't you?
you can but thats not what they want to do
I can't if I want to
They've elapsed
For what it's worth build logs are stuck on loading too
its an old service, and youre on the hobby plan, i dont think logs are kept for that long
But it's being used now and I don't have any present logs
I don't mean historical logs
i know
open the deployment and redeploy it
Doesn't appear to me
interesting
run
railway up againDoesn't that deploy from the code at present?
yes
But I won't be able to rollback?
you arent being shown the 3 dot menu, so it doesnt appear to be an option for you
I'm cautious to redeploy for that reason
railway isnt going to switch to the new deployment if it fails to build
Fair
Thanks, I'll leave it for now but I still don't know what's causing the problem. Has this come up for other people? Just redeploy is the solution?
yeah a redeploy is a good idea
Thread has been flagged to Railway team by @Brody.
It's worse than I thought
oh yeah?
@Fragly https://railway.app/project/2735e0d8-8458-46b3-8998-56ab1d1c4646/service/103508b3-a934-4c60-a942-df4770f16d8f All services in this project have stuck logs
Railway
404 - Page not found
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
But it's only that project, other projects are fine
just so you know, neither me nor fragly work for railway, these links do absolutely nothing for us
Oh
Who do I ping
This is semi serious
Not having any observability is not good
please do not ping anyone
OK
are your apps down?
Calls out to Railway
No but I have no observability
Which is pretty bad
the apps are up, that is what truely matters
but instead of links, show us screenshots please
Sure
This is the second logs problem I've had this week, I wonder if they are related
I just see a forever spinner, only affects this project but affects this project all the way
Service is still up and running along, and I would have Discord notifications if it broke, but I don't like flying blind
okay going to check whos on call
Summarization for the Railway team: I have no logs for this entire project https://railway.app/project/2735e0d8-8458-46b3-8998-56ab1d1c4646/service/103508b3-a934-4c60-a942-df4770f16d8f. It's still working but all logs are infinite spinners. Only appears to affect this project
Railway
404 - Page not found
Railway is an infrastructure platform where you can provision infrastructure, develop with that infrastructure locally, and then deploy to the cloud.
oh shit im sorry i got pinged for something and forgot to check and notify whos on call
It's fine, I just think Railway will want to figure this out it likely affects other people
Last time Ray was on it I think
@char8 - all services within users project have no logs
they rotate, as far as i can tell its char right now
Thanks appreciate it
3 of us see logs
Checking now
Here I recorded a video. Still affects me
Maybe relevant console error
{"message":"Not Authorized","locations":[{"line":9,"column":3}],"path":["tcpProxies"],"extensions":{"code":"INTERNAL_SERVER_ERROR","exception":{"status":400}}}
^try clearing cache and cookies
I did the hard refresh in Chrome Shift Command R
I'll try that as well
No zoom video
fwiw, the zoom video is very jarring, its not needed
can you see if there's a websocket request in the network panel?
Sure, I tried clearing Cookies and Local Storage as well
try in a guest browser so there is no interference from extensions
Here I show the network panel for a working project and the broken project @char8
@Brody @char8 This is in Incognito
you can filter by only websockets activity
and theres no need to ping please
Filtering for WebSockets, I see Status 101
Sure sorry
are there any messages
Yeah see the above video, unless I am on the wrong tab
i watched the video. you didnt open the messages for those websocket connections
Ah I see
Sorry am new to debugging websockets
I think this might be a permissions issue. Can you see if there are any failed network requests
It looks like the same thing as the console.error I pasted above
Looks related
are you the owner of this project?
I'm trying to remember how this is setup, someone else is the owner
are you an editor?
Something is wrong though, this is another project
I should be the editor unless they removed me? Then why would I still see the project
ah okay. This is an issue if you are the viewer of the project
You are a Viewer of the project
Hmm
So it's not a bug?
Even if I am a viewer I can't see logs?
It is a bug. You should be able to view logs as a viewer. Fix incoming
Oh
Got it
Thanks I understand now, must have been an oversight. I didn't even know I was a viewer of this project
I would remove this screenshot (emails in public 🙂)
I'll just delete that screenshot
Anyway just ping me when it's deployed I can confirm on my side if it's working
For the record I'm not sure I'm actually supposed to be viewer for this project. I'll try to confirm with the owner but I don't think they would have intentionally changed me to viewer because they still need my help
Would there be any receipt trail like emails or something to confirm?
unfortunatley not at the moment
K I'll check in with the guy, but it doesn't make sense he would do that because I'm still on call for this project. So I wonder if something else is off. I'll follow up on that but it might take a day to hear back
I heard back from my guy, he doesn't recall intentionally changing my permissions. I was and should be an editor still
OK it looks fixed now
I see logs and I am an editor again
All good now, thank you