Hacker News new | ask | show | jobs
by coolspot 325 days ago
10B * 2000 t/s = 20,000 GB/s memory bandwidth . Apple hardware can do 1k GB/s .
1 comments
oezi 324 days ago
That’s why MoE is needed.
link