[rolph]

why would it be better to host an AI on your PC, rather than in its own local box, with ability to access permitted aspects of your PC ?

i can tell you why a discreet box is better, you can firewall it, or physically unplug it when its not functioning in a desireable manner.

[bottom999mottob]

Same reason people virtualize dozens to hundreds of machines in one box, hardware efficiency.

I don't understand this sentiment.

[rolph]

AI integrated into your PC, means cooperating with an AI to use your PC. this also restricts your[sic] AI.

your AI should go with you and saddle into task specific hardware, be that a home automation bus, LAN dock, automobile, or roomba-iod R2 like unit.

your AI should be your wingman and have your back. but being an agent capable of deciding without your input, there should be a way of training acceptable bounds into your AI. [yes that is looking like a mobile]

likewise there should be physical restraint when it gets a "bad idea"

[wtallis]

You're talking like we already have artificial general intelligence that can autonomously initiate actions, when at best what can run on a single consumer device is a very small, dumb LLM. So none of what you're trying to worry about makes any sense for this discussion.

[chung8123]

Every AI inference costs money. It would be better for them to have these ongoing expenses on the user side vs them having to pay for the expense.

[mock-possum]

Why would anyone strap a couch to the top of their car, when it would be better to buy a new pickup truck and transport it in the back of that?

[Zetobal]

Because we don't need 12 boxes when 1 box is enough.