How does multiple priorities for GPUs assign to me workers?
Wondering what is the algorithm behind selecting gpus when i have like 3 selected; and also if for example 4090s is my first priority even if it throttles like 7/10 of my workers it seems to keep it there.
So i reassigned the priorities and reset my workers to see if I get a better distribution to not rely so heavily on 4090s but im wondering then what is the algorithm even doing with these priorities?
3 Replies
I also don't understand this and it never seems to actually do anything, always only uses #1 and never #2, #3 etc, but according to @flash-singh it works. I have yet to see it work though.
@JM Just want to ping JM too b/c this came up b/c I was talking to him, where he pointed out my priority was originally on 4090s, which is why my stuff is so heavily 4090s, but I guess I also wonder what is the expected behavior for priorities?
It seems ill defined and no where in docs either what this means + what happens when regions fall in and out of avaliability
@flash-singh ;D but yeah, if u also know what is expected behavior for priority, this would be great, so that I can test it out / know if it isn't acting correctly. Just it is unknown
Oh wow, you guys are right on point today.
I just discussed with @Justin Merrell about this, this afternoon.
We are adding:
- A section in the docs that goes into more details about the priority order.
- Will modify UI a bit to provide clarity. Because it appears it's not intuitive as it is; we want something that users get right from the first sight!