[lugu]

What we need today is a standard local API (think of it as a POSIX extension). So that each desktop app that needs AI to enhance a feature can simply call that. This way, those apps will need to handle the case where AI is not availabile. This will empower users.

[charcircuit]

All major operating systems Windows, macOS, iOS, and Android have local APIs for using AI.

[hedora]

Why would I use those instead of just grabbing a model from hugging face? Are they as good as qwen 30B?

[charcircuit]

Because it is simpler as an application developer to just use an OS API then trying to figure out some 3rd party thing and setting that up. Each platform has several different models for different things so I can't give a comparison.