Best way to dynamically load balance across hundreds of nodes?
As the title says, what is the best way/is it possible to use Cloudflare to load balance across hundreds of nodes dynamically.
For context, we are currently using ELB to balance across our nodes which auto scale, but it has caused us quite a significant amount of issues recently which leads me to my next question:
If it is possible can we set a limit to how many connections get sent to a single node? Recently ELB has completely nuked our system due to how aggressively it directs hundreds of thousands of connections to nodes causing them to run out of file descriptors, which causes a chain reaction.
Again if it's possible, can we dynamically assign and un-assign nodes to balance across (this is a auto-scaling system so nodes go up and down all the time)
1 Reply
The biggest concern is the "Don't overload the nodes" part really, since currently, if too many nodes go down, ELB effectively DDOS's the remaining nodes
Looks interesting, thanks!
The only thing I can't see is if we can assign a cap, the LOR steering definitely would be an improvement, but I think we still have issues in the even a large number of nodes go down
Ah never mind I have found the load shedding section