[mcintyre1994]

I think this is just Apple planning for their on-device models getting better, which makes sense given they have access to Gemini now. If developers use this for all their code calling an external LLM, then as Apple's model becomes more capable and covers more use cases it'll be easy to switch to it at individual call sites. That'll give apps better UX and save developers money on a bill that Apple doesn't get a cut of.

[embedding-shape]

> That'll give apps better UX and save developers money on a bill that Apple doesn't get a cut of.

With other words, it's unlikely to happen as there is no money in it. Better for Apple to create some new subscription "AI" and "AI-lite" plans people can subscribe to, and since Apple is a company and we all know what those care about, it's unlikely to become a utopia of local models running on your phone.

[criddell]

How does using Gemini lead to better on-device models?

[Danox]

Gemini is just a stopgap like using Intel processors or Qualcomm modems.

[halJordan]

Apple is distilling models from gemini

[Danox]

UX is just another word for ecosystem building, which is what Apple does best in comparison to their competition and also doesn’t hurt to do hardware to go along with it. Microsoft and Nvidia aren’t teaming up for nothing.