phantuma
RRunPod
•Created by phantuma on 11/27/2024 in #⚡｜serverless
is it possible to send request to a specific workerId in a serverless endpoint?
I need to have a custom logic to distribute requests to available workers in the serverless endpoint. Is there a way to send request to a specific worker using workerId?
6 replies
RRunPod
•Created by phantuma on 11/25/2024 in #⚡｜serverless
Pods not getting started
Whenever my endpoint receives new requests and it autoscales to create new pods, a few of the pods get stuck while booting and don't respond. Also, while this happens I am being charged because somehow that is considered as uptime, certainly not a fault with my code and multiple other pods work fine on boot
3 replies