this is a big move. i think in general data centres are overblown, open source models that run on your laptop are getting better and better and more and more popular. it's discussed here: https://johnny588358.substack.com/p/why-ai-infra-is-overblow... tdlr: a lot of infrastructure spending might wind up being wasted funds. i'd imagine more cities/counties are going to be moving this way, whether thats really good or not, i dont know
I don't think these small models are really that powerful yet and I don't really like the direction of per device localized models baked in to the OS. To wimpy and untrustworthy.
I want claude power, in a box, at my house, for my entire family completely compartmentalized from my operating system.