Hacker News new | ask | show | jobs
by Wytwwww 769 days ago
> there’s more memory available for linear algebra in a maxed out MBP than the biggest GPUs you can buy.

But this hardly applies to 95% if not more people of all people running Apple's hardware, the fastest CPU/GPU isn't worth much if you can fit any at least marginally useful LLM model on the 8GB (or less on iPhones/iPads) of memory that you device has?