[alwillis]

> If you are using LLMs for tool use locally, then in a decade it will not make sense anymore to pay for hosted solutions. Your device will have compute power to run powerful LLMs trivially.

LLMs a couple of years ago that'd be impossible to run on consumer hardware are now running on consumer hardware. I'm less concerned about compute power; it's more about memory.

It could be several years before new RAM capacity comes online. Even then, it won't be cheap.

I expect in the future, hosted frontier models will be a utility like electricity or cable tv. Part of a package most people will subscribe to.