Hacker News new | ask | show | jobs
by dgellow 7 days ago
Memory isn’t getting cheap soon, and you need a lot of it for local models
1 comments

All depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware
Ah yes, if you count in decades, for sure I expect to run them locally