Gateway timeout errors during heavy traffic
Hello we are having some traffic spikes and getting periodic gateway timeout errors
12 Replies
Please provide your project ID or reply with
N/A. Thread will automatically be closed if no reply is received within 10 minutes. You can copy your project's id by pressing Ctrl/Cmd + K -> Copy Project ID.No project ID was provided. Closing thread.
what kind of app?
LLM Chat app, uses streaming as well
flask?
next.js
we got a heavy spike in traffic, metrics were way up from normal in the last few hours. was wondering if it was related to autoscaling
railway only scales vertically
the gateway timeout wouldn't be railways fault
do you run your service behind a caching cloudflare proxy?
yes we do, so you think its cloudflare rate limiting us?
Actually just double checked, this url is not being proxied
well there's your problem
next js does have a built in production server, but I'm sure it has its limitations
I am seeing network drops. If it was the applications fault, wouldn't the inbound not drop?
Not trying to point fingers, just want to isolate the issue and resolve
@Brody do you know why traffic is dropping
i don’t, sorry, you'll have to do some debugging