[YetAnotherNick]

You can run model >100x faster in cloud compared to on device with DDR RAM. This would make up for the reception.

[dagmx]

And you can’t run the cloud model at all if you can’t talk to the cloud.

[YetAnotherNick]

Yes, but I can't imagine situations where I "have" to run a model when I don't have internet at that time. My life would be more affected with the rest of the internet than having to run a small stupid model locally. At the very least until the hallucination is completely solved, as I need internet to verify the models.

[dagmx]

You’re assuming the model is purely for generation though. Several of the Gemini features are lookup of things across data available to it. A lot of that data can be local to device.

That is currently Apple’s path with Apple Intelligence for example.

[michaelmrose]

Hallucination can't be solved because bogus output is categorically the same sort of thing as useful output.

It has no world model. It doesn't know truth any more than it knows bullshit just a statistical relationship between words.