[ArtWomb]

Per Brendan Gregg's Gesamptkunstwerk, BPF Performance Tools, I feel like you should be able to measure instructions per cycle at the service level. Even in the cloud if exposed by Xen. And even at the resource utilization level for each container.

http://www.brendangregg.com/bpf-performance-tools-book.html

Of course, you can always just use cloudflare ;)

[kjeetgill]

The problem is how fast and how frequently can you get that information back to the one more nodes making load balancing decisions? The local measurements, no matter the mechanism of collection, are usually the easiest/fastest part.