Hacker News new | ask | show | jobs
by GaggiX 366 days ago
This calculation doesn't account for batches, it makes no sense.
1 comments
BriggyDwiggs42 366 days ago
On average how much does batching bring costs down?
link
GaggiX 366 days ago
It balances the computing and memory bandwidth bottleneck so by a lot, with continuous batching you can easily see a x10, x20 or more.
link
BriggyDwiggs42 365 days ago
Wow! Thanks.
link