Hacker News new | ask | show | jobs
by bitmasher9 5 hours ago
512GB unified memory is targeting local inference of large models, or local training of non-frontier models.
1 comments
drnick1 5 hours ago
I doubt you can run a model that requires hundreds of GB of RAM at an acceptable speed (tok/s) on a MacBook.
link
aroman 3 hours ago
What would be the bottleneck?
link