Gambaru Consulting
Sleeping service not waking in response to POST on internal network
Hi All,
Project ID: f54d62f5-02ea-4819-9882-dd03c6717a60
I have a public backend with FastAPI with hypercorn that handles login and some services. I am trying to spin out services into the private network for scalability and security. To test this, I have a private FastAPI service that hosts a language model.
There seem to be some problems with the interaction between sleep and internal networking.
When the service is not sleeping, if I send a POST request from the public API docs or from the front end, I get a 200 response as expected.
Once the service is sleeping, it does not wake up when it gets a POST request either from the public API or from the front end.
Logs show lines including:
[86] [ERROR] Error in ASGI Framework Connection timed out Max retries exceeded On the public API. No logs on the private service after sleeping.
Is this a known issue? Is there a potential workaround for this? And is Railway suited for this use case?
I can find hacky ways around this issue that are less efficient, but I would prefer to use the sleep and private networking features if at all possible.
Thanks in advance for any help with this.
Choo-choo.
There seem to be some problems with the interaction between sleep and internal networking.
When the service is not sleeping, if I send a POST request from the public API docs or from the front end, I get a 200 response as expected.
Once the service is sleeping, it does not wake up when it gets a POST request either from the public API or from the front end.
Logs show lines including:
[86] [ERROR] Error in ASGI Framework Connection timed out Max retries exceeded On the public API. No logs on the private service after sleeping.
Is this a known issue? Is there a potential workaround for this? And is Railway suited for this use case?
I can find hacky ways around this issue that are less efficient, but I would prefer to use the sleep and private networking features if at all possible.
Thanks in advance for any help with this.
Choo-choo.
39 replies