[draginol]

So this is probably not good news for the MacBook Ultra with 512GB of RAM rumors being..affordable.

What's worse is that this is probably going to get worse. My angel investment group is getting inundated with pitches that amount to building an RX-6000 with 96GB of RAM and installing a local model to do "thing X".

So even if the OpenAI's of the world stop trying to use up all the RAM, you're going to have thousands of start-ups pushing local models.

[thewebguyd]

Makes me really wonder about that new Surface Ultra pricing with the nvidia chip in it.

If Apple can't pull it off with their supply chain weight they can throw around, what is that thing going to be priced at? Microsoft/Nvidia are either going to be subsidizing it or it's gotta be close to $8,000+ at launch.

[drnick1]

> So this is probably not good news for the MacBook Ultra with 512GB of RAM rumors being..affordable.

Why would anyone need that much RAM in a laptop?

[bitmasher9]

512GB unified memory is targeting local inference of large models, or local training of non-frontier models.

[drnick1]

I doubt you can run a model that requires hundreds of GB of RAM at an acceptable speed (tok/s) on a MacBook.

[aroman]

What would be the bottleneck?