Every generation seems to have to learn the lesson about batching small inputs together to keep throughput up.