Hacker News new | ask | show | jobs
by drnick1 5 hours ago
> So this is probably not good news for the MacBook Ultra with 512GB of RAM rumors being..affordable.

Why would anyone need that much RAM in a laptop?

1 comments

512GB unified memory is targeting local inference of large models, or local training of non-frontier models.
I doubt you can run a model that requires hundreds of GB of RAM at an acceptable speed (tok/s) on a MacBook.
What would be the bottleneck?