Hacker News new | ask | show | jobs
by saxonww 1110 days ago
Not only that, it's shared memory with the on-chip GPU. Isn't this a big downgrade in both memory capacity and GPU capability?
2 comments

One thing I was surprised to not see any comments from Apple on is whether GPUs will still be supported in the PCIe slots. It'd require work from either AMD or Nvidia to get an ARM64 macOS driver so maybe that's the holdup there. It's hard to compete with max builds which have many GPUs in raw power without the ability to go beyond the built in GPU. That said, 192 GB of 800 GB/s VRAM is pretty crazy at the price point.
It could be a positive for GPU capability - such as models that would be constrained on GPUs of say 24 GB.

This will be a positive development for LLMs like Llama.