Hacker News new | ask | show | jobs
by nradov 29 days ago
Regardless of VC subsidies, the cost of compute always trends down over time. Whether you like it or not, LLMs will be a pervasive part of everyone's life forever (or at least until a better replacement comes along).
1 comments

Cost of compute trending down is usually lost as the resulting software bloat that fills the empty space like a gas. We already see this with LLMs. Models get bigger and bigger in an arms race.
OK so the frontier models will be capable of doing even more, but the simple stuff they can do today will get much cheaper.
I don't think that is a safe assumption to make. Moore's law is not playing out any longer as it used to. Jensen Huang already called it dead 4 years ago.
Incremental reductions in compute costs don't depend entirely on Moore's Law.