[cpeterso]

Why buffer on the app server?

[zhong-j-yu]

Because we have multiple app servers, but only one reverse-proxy? I don't want to centralize a task that could be distributed.

[vampirechicken]

So you're basically causing your own problems by refusing to scale your proxy layer, which should be dirt cheap hardware, while scaling your beefier app servers. You basically have it backwards.