[hbn]

On the other hand, no one has figured out how to make money providing AI yet, and everyone's operating at a loss. At some point they're going to need to monetize, and the cost/convenience compared to alternatives may not be worth it for a lot of people.

At one point you could get a Netflix subscription and it was convenient enough that people were pirating less. Now there's so many subscription services, we're basically back to cable packages, paying ever increasing amounts and potentially still seeing ads. I know I'm pirating a lot more again.

Uber vs cabs, Airbnb vs hotels - We've seen it time and time again, once the VC cashflow/infinite stonk growth dries up and they need to figure out how to monetize, the service becomes worse and people start looking for alternatives again.

[VBprogrammer]

Yeah, but not just that. I don't expect my mum to go find some high end consumer GPU and install it on a home server in order to run her own local LLM. I expect that people will be throwing chat interfaces running remixed versions of open weight models out on the internet so fast that it's impossible for anyone to monitise it in a reasonable way.

I also wonder whether, similar to bitcoin mining, these things end up on specialist ASICS and before we know it a medium tier mobile phone is running your own local models.

[fragmede]

A top end iphone is capable of running smaller local LLMs today.

[hbn]

A few days late but the cheapest, base model iPhone, the 16e runs Apple Intelligence too

(Unfortunately... only Apple Intelligence right now...)

[fragmede]

I don't have a newer iphone to run it on, so I don’t have a specific one to recommend but searching for local LLM in the App Store gives plenty of options so you’re not limited to Apple Intelligence models.