[nonameiguess]

I guess it probably won't matter in the long run as hardware requirements continue to get lesser, but the "overwhelming majority of users" don't have anything close to an M-series Mac right now. More like a Galaxy S3, if that.

[theshrike79]

I'm predicting that phones will get AI-optimised chips in the next 2-3 years, enough to run specific optimised models on-device.

They'll get specific models trained to do things that make sense locally + the ability to fetch data from the cloud if needed.