Hacker News new | ask | show | jobs
by BriggyDwiggs42 362 days ago
On average how much does batching bring costs down?
1 comments
GaggiX 362 days ago
It balances the computing and memory bandwidth bottleneck so by a lot, with continuous batching you can easily see a x10, x20 or more.
link
BriggyDwiggs42 362 days ago
Wow! Thanks.
link