[RonnieOwnsLexus]

But wont it be that in real life no one would want to run a voice command which consumes lot of CPU and battery as opposed to making a network call to a service which has this model hosted ?

Agreed that this can always be improved and hardware can get more efficient and better to but at the end of the day, would it ever be better then an API call ?

[nmcfarl]

I live in eastern Oregon on a property with no cell service.

I use Siri a lot, mainly to add reminders, and sometimes I try to use Siri when I'm out at the greenhouse, which is just past the edge of the mesh network. I would love for those reminders to get added - even if it burnt battery.

And more generally I would love for people writing apps to consider that phones don't always have service - as would my neighbors.

[Tepix]

Privacy concerns are justified.

It's not just that, this can also work completely offline.

[irusensei]

I'm looking forward to run stuff like this online. Using bigtech corporate souls SaaS AI is just pure dystopia material.

It's even better that we are talking about a relatively low power machine here. Maybe can operate offered.

[Tepix]

You mean offline?

[sebzim4500]

Ultimately, no amount of technology will ever beat the speed of light. Running locally will always have a lower latency floor.

[brookst]

Theoretically yes. But in the real world, no.

Simple thought experiment: you want to know how many tons of copper are mined in the US each year. Lowest possible latency is calculating this in your head, most likely using data you don’t have. Looking it up online is a lot, lot faster.

In some far future world maybe every transistor will include the sum total of human knowledge up to the nanosecond, but that’s a pretty far future. There are many things where running locally means a higher latency floor.

[brucethemoose2]

Its still cheaper to run a free model on a competitive "dumb" cloud host than buy a service only one company provides.

[q7xvh97o2pDhNrh]

There are still a few people in the world who don't have always-on gigabit internet access everywhere they go.

[grandiego]

"There is No Reason for Any Individual To Have a Computer in Their Home"