RunPod•8mo ago

'Connection reset by peer' after job finishes.

Previous logs indicate that the handler works correctly. Happened multiple times now and returns failure response. Any input on this issue? @Papa Madiator

2024-04-17T07:48:57.719183260Z {"requestId": "92b3176b-81d0-4dbb-9307-9cbe812dd8f0-u1", "message": "Finished.", "level": "INFO"}
2024-04-17T07:49:03.090390819Z {"requestId": null, "message": "Failed to get job. | Error Type: ClientOSError | Error Message: [Errno 104] Connection reset by peer", "level": "ERROR"}

2024-04-17T07:49:03.090448408Z {"requestId": null, "message": "Traceback: Traceback (most recent call last):\n  File \"/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_job.py\", line 55, in get_job\n    async with session.get(_job_get_url()) as response:\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client.py\", line 1194, in __aenter__\n    self._resp = await self._coro\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client.py\", line 605, in _request\n    await resp.start(conn)\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client_reqrep.py\", line 966, in start\n    message, payload = await protocol.read()  # type: ignore[union-attr]\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/streams.py\", line 622, in read\n    await self._waiter\naiohttp.client_exceptions.ClientOSError: [Errno 104] Connection reset by peer\n", "level": "ERROR"}

2024-04-17T07:48:57.719183260Z {"requestId": "92b3176b-81d0-4dbb-9307-9cbe812dd8f0-u1", "message": "Finished.", "level": "INFO"}
2024-04-17T07:49:03.090390819Z {"requestId": null, "message": "Failed to get job. | Error Type: ClientOSError | Error Message: [Errno 104] Connection reset by peer", "level": "ERROR"}

2024-04-17T07:49:03.090448408Z {"requestId": null, "message": "Traceback: Traceback (most recent call last):\n  File \"/usr/local/lib/python3.10/dist-packages/runpod/serverless/modules/rp_job.py\", line 55, in get_job\n    async with session.get(_job_get_url()) as response:\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client.py\", line 1194, in __aenter__\n    self._resp = await self._coro\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client.py\", line 605, in _request\n    await resp.start(conn)\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/client_reqrep.py\", line 966, in start\n    message, payload = await protocol.read()  # type: ignore[union-attr]\n  File \"/usr/local/lib/python3.10/dist-packages/aiohttp/streams.py\", line 622, in read\n    await self._waiter\naiohttp.client_exceptions.ClientOSError: [Errno 104] Connection reset by peer\n", "level": "ERROR"}

3 Replies

digigoblin•8mo ago

Seems to be same issue as #Connection reset by peer Is your endpoint within a specific region or is it set to Global?

pazanchickOP•8mo ago

Hi, not sure how to check that. The sls endpoint has all datacenters selected (under advanced)

digigoblin•8mo ago

Then its global

Gaming

Programming

'Connection reset by peer' after job finishes.