The LB will see the unresponded requests and think your webserver is failing.
Ideal would be to respond at the webserver and let the LB drop the response.