I hope the miniaturization will continue the trend from Mac Mini to Raspi to Solid-Run's CuBox in hardware body plan. The Sony chewing gum usb-stick format that attaches to a storage back power plane like a bar of Toblerone geometric chocolate is one possible look. The software re-purposes the recovered MIT/Stanford v100 Lisp Machine concepts and markets the aiOS machine under the brand: Liminal Lisp Machine Semiotics Software 2.0 with unlimited eyes and engines. [LLMSS2]
I don't see why it would need to be part of the actual OS.
More likely we'll get an AI shell, like a Google Assistant trying to do what BASH does, which would be awesome.
If I were to do one, which I've thought about, it would be based on traditional NLP and only ever use AI for specific "skills".
It would be stack based rather than pipeline based, matching how voice computing works in the movies. You'd say "Go to this folder", "find all image files containing a duck", "Zip those files", "send the zip to Fred", "confirm Fred Miller", etc.
* https://en.wikipedia.org/wiki/CuBox