[sisve]

> I am not sure how many people will run AI models locally. It still seems like a niche application to me.

Bill Gates had a quote some years ago...

People have still not learned how fast we improve our tech and how much cheaper thing gets I guess :)

[chaostheory]

We had a thing called globalism that drastically reduced costs. Globalism right now is on life support. Given geopolitics, I don’t see how it’s going to survive.

[sisve]

You are right. I haven't considered that enough. I do agree with you that globalism will be decreased even in the context of a decade, but I think it will be on a level that still give us some cost reduction. But I do think (at least hope) geopolitics will be better in 5-7 years.

[dgellow]

Memory isn’t getting cheap soon, and you need a lot of it for local models

[sisve]

All depends. The current technology will be cheaper in a year or two. The best cutting edge stuff will properly be even more expensive. But in 10 years time... we can run current SOTA models (or models that are equally good ) on our local hardware

[dgellow]

Ah yes, if you count in decades, for sure I expect to run them locally