[anthonypasq]

Guys, we are the in the mainframe era of AI. People in the 60's thought computing was expensive too and the idea of having a computer on every desk, nevermind every pocket, nevermind every single piece of electronics in the world basically seemed like a complete pipe dream.

if you told someone in the 70's their toaster would have a supercomputer it in, they would think you were crazy. in 10 years your doorknob is going to have a local AI model it in.

This is computing 2.0 not the dot com bubble. 90% of inference will be at the edge in the future and there will still be super-computers and giant clusters doing cutting edge science and research, but for 90% of use cases youll just need a tiny local model, same reason you dont need a giant GPU in your smart tv.

[stephc_int13]

The main issue with this reasoning is that the hardware substrate for AI and good old computing is the same.

All governed by Moore's Law, what happened then seems extremely unlikely to happen again, the curve is a sigmoid and we're much closer to the flat end now.

[anthonypasq]

I think this has some truth to it I would say, but im pretty confident that small models will continue to get better and runnable on dedicated consumer hardware