Hacker News new | ask | show | jobs
by montfort 20 hours ago
Take a look at the AMD Ryzen AI Halo Developer Platform with a Ryzen AI Max+ 395 processor. These systems, with 128GB of unified memory and their specialized processors, deliver greater performance and inference power than Apple's Mac Studio. This already allows you to run fairly decent models for personal classification and coding tasks. I think for complex design needs you'll still require frontier models that can only be run in large data centers, but much of the underlying work could already be done on-premises.