kylegill (kg)
kylegill (kg)
RRailway
Created by Deani1232 on 1/18/2024 in #✋|help
Getting intermittent connection errors on all services connected to my uptime kuma.
We haven't detected any alerts since 11:50am MST (18 min ago)
78 replies
RRailway
Created by blandthony on 1/18/2024 in #✋|help
Getting upstream errors, ALL requests failing outside of US
Hey @blandthony , for what it's worth, we've got others in another open thread (https://discord.com/channels/713503345364697088/1197584373227200703) with the same issue. Hoping to get things escalated. We suspect it's related to this incident: https://discord.com/channels/713503345364697088/846875565357006878/1197588980653375588
7 replies
RRailway
Created by Deani1232 on 1/18/2024 in #✋|help
Getting intermittent connection errors on all services connected to my uptime kuma.
We were alerted by Checkly that we use to monitor our public customer-facing API endpoints. We thought maybe something was wrong on their end, but have since replicated myself on my machine. I came here when that happened, and wondered if it was networking that we didn't control, since we haven' t pushed any code to our affected service in the last week.
78 replies
RRailway
Created by Deani1232 on 1/18/2024 in #✋|help
Getting intermittent connection errors on all services connected to my uptime kuma.
We don't use private networking (unless there is something automatically configured for us)
78 replies
RRailway
Created by Deani1232 on 1/18/2024 in #✋|help
Getting intermittent connection errors on all services connected to my uptime kuma.
I came here to report the same, we're on FastAPI on a single instance (no app sleeping), and having been getting errors all morning (for the last hour and a half):
upstream connect error or disconnect/reset before headers. reset reason: connection failure, transport failure reason: immediate connect error: Cannot assign requested address
upstream connect error or disconnect/reset before headers. reset reason: connection failure, transport failure reason: immediate connect error: Cannot assign requested address
I've only been able to replicate on a few occasions, and retires almost always fix it. They are intermittent. We had no code changes to our app server. If helpful our project ID is: 1d3ab213-7e4f-45f6-a136-1326d80d0606
78 replies
RRailway
Created by kylegill (kg) on 11/22/2023 in #✋|help
Plugin -> Database Service migration resulted in unlinked Preview Environment variables
Just tried the isolate changes options and that worked to make sure we got the variables on new preview environments. We'll look forward to other changes but that does help us keep our same workflow, thank you!
10 replies
RRailway
Created by kylegill (kg) on 11/22/2023 in #✋|help
Plugin -> Database Service migration resulted in unlinked Preview Environment variables
Thanks jr, we'll try the isolate changes option as a workaround for the time being. I expected I might see some variables on the Redis service though, does that mean that the exact same variables from the prod environment remain the same on each new preview environment's service? (same password, same host, etc?..) I guess I assumed maybe those variables were changing.
10 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
Okay yeah that's gotta be it! Seems like it was when we opened up other PRs that created new environments.
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
I'll try deleting it again, when you mean activity in other environments like new preview environments being opened? I'll see if the times we've created preview environments line up with the times we saw re-deploys...
50 replies
RRailway
Created by kylegill (kg) on 11/22/2023 in #✋|help
Plugin -> Database Service migration resulted in unlinked Preview Environment variables
No description
10 replies
RRailway
Created by kylegill (kg) on 11/22/2023 in #✋|help
Plugin -> Database Service migration resulted in unlinked Preview Environment variables
No description
10 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
(Probably conflating unrelated things, just trying to give plenty of info)
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
No description
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
We don't call the GraphQL API ourselves (which I assumed that might be related to?..). I don't know if this is helpful or not but noticed that after I ran the Reset freeform Quick command I saw the Redis Legacy plugin appear again. Not sure what connection there was between that old plugin and the newer database service, but maybe I got something stale back.
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
Yeah we don't hit it super hard. I don't know if context really makes a huge difference but we use it for rate limiting and some simple caching.
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
Ahh good distinction yes. Since it only starting happening after migrating to the service I thought maybe there'd be something connected.
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
I wondered if we could be doing some in our code that overwhelmed it or something, but I wasn't seeing hints to that in the Redis logs
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
Very possible we have some crappy code somewhere too, not gonna discount that possiblity 😅
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
No description
50 replies
RRailway
Created by kylegill (kg) on 11/21/2023 in #✋|help
Redis re-deploys on new Database services after migration
(As another datapoint, it just restarted again)
50 replies