[KenanSulayman]

Yes, I get that. But in Mesos, for instance, you could use overlay-networks to get one virtual IP per HAProxy cluster (i.e. 3 HAProxy instances). They are then round-robin'd on each server in the whole cluster so that you have a transparent LB with a singular IP.

[atombender]

Round-robin routing is one way that really doesn't cut it at the level of scale that Github and others operate at. Overlay networks also typically have no notion of load and how to send traffic to the hop with the least amount of load.

[user5994461]

Use least connections for HTTP load balancing, it is load aware.

[atombender]

That's an HAProxy option. What do you do to load-balance HAProxy itself? That's what the article about.