Y
Hacker News
new
|
ask
|
show
|
jobs
by
boroboro4
166 days ago
This being said in this setup of 2-4 h100 you’ll be able to generate with batch size of somewhere around 128 ie its 128 humans and not one. And just like that difference in efficiency isn’t that high anymore.