[nine_k]

"100% overcapacity" is also known as "50% load factor".

It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.

[sambazi]

just think about your competitive edge if you could manage to cramp more load w/o affecting latency

[jdougan]

Depends on what you have to pay (and not just in money) to get there.