Hacker News new | ask | show | jobs
by JohnBooty 535 days ago
They have, because until now Apple Silicon was the only practical way for many to work with larger models at home because they can be configured with 64-192GB of unified memory. Even the laptops can be configured with up to 128GB of unified memory.

Performance is not amazing (roughly 4060 level, I think?) but in many ways it was the only game in town unless you were willing and able to build a multi-3090/4090 rig.

1 comments

I would bet that people running LLMs on their Macs, today, is <0.1% of their user base.
People buying Macs for LLMs—sure I agree.

Since the current MacOS comes built in with small LLMs, that number might be closer to 50% not 0.1%.

I'm not arguing whether or not Macs are capable of doing it, but whether is a material force that drives people to buy Macs because of it; it's not.
Higher than that buying the top end machines though, which are very high margin
All macs? Yes. But of 192GB mac configs? Probably >50%