[VBprogrammer]

Yeah, but not just that. I don't expect my mum to go find some high end consumer GPU and install it on a home server in order to run her own local LLM. I expect that people will be throwing chat interfaces running remixed versions of open weight models out on the internet so fast that it's impossible for anyone to monitise it in a reasonable way.

I also wonder whether, similar to bitcoin mining, these things end up on specialist ASICS and before we know it a medium tier mobile phone is running your own local models.

[fragmede]

A top end iphone is capable of running smaller local LLMs today.

[hbn]

A few days late but the cheapest, base model iPhone, the 16e runs Apple Intelligence too

(Unfortunately... only Apple Intelligence right now...)

[fragmede]

I don't have a newer iphone to run it on, so I don’t have a specific one to recommend but searching for local LLM in the App Store gives plenty of options so you’re not limited to Apple Intelligence models.