Using Multi process pool with serverless cpu sometime cannot stop.
for My Script speed increase. I use multiprocess for my LLM Translation (open-AI API Usage (LangChain)). but Sometime the worker stop with 0% cpu usage in very long time.
1 Reply
and than it will killed by "null" request Id message.
Although I added a 5-minute timeout to all possible control sections, the timeout doesn't work at all. During multiprocess operations, worker termination requests keep coming in from null request IDs, but I cannot identify the reason. If you have any information about this issue, I would like to know.