Hacker News new | ask | show | jobs
by wmf 800 days ago
Right now Apple hardware is silly compared to PC+Nvidia if you wanna play around with GenAI.

You mean it's silly how far ahead Apple is since they offer 192 GB of VRAM while Nvidia only allows 24 GB for reasonable prices? Or do you mean it's silly to compare <$10K Macs with >$30K Nvidia setups in the first place?

1 comments

What would be silly is running a 192 GB ML model on a chip that slow. In practically every case you would be better off with a multi-GPU PC or a cloud GPU instance, simply because the performance gap is so enormously massive. You can buy a whole lot of cloud GPU hours for the price of 192 GB in a Mac, especially when you consider that you don't have to pay extra for the electricity and you don't need the very latest chips to far outperform Apple's best.