rom5031
rom5031
PostsComments
RRailway
Created by rom5031 on 2/28/2024 in #✋｜help
Buggy deployment since migration to EU West
No description
24 replies
RRailway
Created by rom5031 on 2/28/2024 in #✋｜help
Unable to add more gunicorn workers on Django project
Hey 👋 Just upgraded to Pro, I wanted to add more gunicorn workers to get more capacity (going from 8 -> 16), but the additional workers are unable to start. Error message: 
File "/usr/local/lib/python3.11/site-packages/sentry_sdk/worker.py", line 70, in start
self._thread.start()
File "/usr/local/lib/python3.11/site-packages/sentry_sdk/integrations/threading.py", line 56, in sentry_start
return old_start(self, *a, **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/threading.py", line 964, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 32: Resource temporarily unavailable
OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
File "/usr/local/lib/python3.11/site-packages/sentry_sdk/worker.py", line 70, in start
self._thread.start()
File "/usr/local/lib/python3.11/site-packages/sentry_sdk/integrations/threading.py", line 56, in sentry_start
return old_start(self, *a, **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/threading.py", line 964, in start
_start_new_thread(self._bootstrap, ())
RuntimeError: can't start new thread
OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 32: Resource temporarily unavailable
OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
It runs fine locally, any hint? Thanks in advance !
5 replies
RRailway
Created by rom5031 on 2/26/2024 in #✋｜help
Monitor queuing time
Hey 👋 Is there a way to add a specific header (X-Request-Start, for NewRelic) when a request hits railway infra so we are able to monitor queuing time for our app? Or if there is any other way to know when all of our web workers are busy and requests are waiting to be processed that would work too. Thanks!
5 replies
RRailway
Created by rom5031 on 1/5/2024 in #✋｜help
About volume size limit
Hello, we plan to use volume connected to our webapp to cache some files. What will happen when the size limit (5GB) for the volume will be reached? Is there any file rotation mechanism or do we need to handle it ourself?
7 replies
RRailway
Created by rom5031 on 12/7/2023 in #✋｜help
High response time from webserver to PG database
Hello 👋 Since a few hours (maybe yesterday), we noticed a big increase in response time on our production API. It seems to be due to database latency, as the baseline runtime for our /ping endpoint (that does a dummy select to the DB) is >200ms. It only happens on our production env, everything seems fine on the staging env (<20ms for the /ping endpoint) project id: 946c760b-c58f-4c9a-98b8-b3fe1d360c6c production ping: https://heatpump-backend-production.up.railway.app/ping/ staging ping: https://heatpump-backend-staging.up.railway.app/ping/ (there is a X-Runtime header in the response, so we ignore latency to end user) Is there any way to diagnose what's happening? Thanks !
7 replies
RRailway
Created by rom5031 on 11/30/2023 in #✋｜help
Database not starting
Hey 👋 Since 1 hour, our backend can not connect to our PG database, we are not able to connect using psql either and the restart database feature does not work (error after trying to restart: "Error restarting database, Problem processing request") PG host: containers-us-west-50.railway.app Is there any ongoing incident? Thanks in advance
18 replies