Hacker News new | ask | show | jobs
by tosh 2 hours ago
macbooks (macs in general) are a good package for llms because they come with so much RAM

and for llms more RAM means access to better models

macbooks might not be as fast as a GPU with similar amount of RAM but more affordable and well integrated

last but not least: compared to a PC+GPU the macbook is either silent (air) or at least way less annoying when you care about noise

for ultimate flexibility and low noise: GPU in the cloud for when you need/want it is probably also most cost effective if you don't have workloads that need to run 24/7