is it possible to send request to a specific workerId in a serverless endpoint?
I need to have a custom logic to distribute requests to available workers in the serverless endpoint. Is there a way to send request to a specific worker using workerId?
4 Replies
this feature is not available, is it because you have a specific model loaded on the worker id?
yes, exactly. I though of tracking particular workerId models and route the requests accordingly
if you have any other solution for this, please let me know. I am using comfy btw
we are brainstorming around this use case, dont have any eta yet, likely goal is to allow some type of routing in future
cool, thanks