[matchaonmuffins]

I wonder if it will make sense to have a central natural language parser of sorts managed by the OS that includes a model like this?

So all command line programs can hook into this model at runtime, and you can have adaptors for fine-tuning etc.

[ainch]

Apple already have this working on iOS - as discussed in this recent post.

https://unix.foo/posts/local-ai-needs-to-be-norm/

[ilaksh]

Yes I assume some kind of LLM system will eventually make its way into OS package registries and eventually there will be a standard of some sort. Already OpenAI's API is the de facto standard available from all providers. But who knows what port it's on. Maybe implement mDNS/DNS-SD or SSDP, and if not there it could just go through default ports like the Ollama one and check for a certain endpoint.