[monsieurbanana]

The amount of people that will run their own models is negligible at the scale of the society. You also can't choose to cut yourself off from the bad outcomes, no matter how much you try. Propaganda 3.0 might not affect you directly, but the political outcomes it produces will.

[pmarreck]

> The amount of people that will run their own models is negligible at the scale of the society

Let me transpose your sentence back to 1980:

"The amount of people that will run their own computers is negligible at the scale of the society"

(I was 8 in 1980. People literally said this.)

All someone needs to do is to productize a whole-house LLM that does voice to text, runs the LLM, does text back to voice (possibly mimicking whatever voice you want), and you'd have an Alexa replacement that is far smarter. I'd buy it in a heartbeat just so that I wouldn't have to do maintenance on it.

[monsieurbanana]

But people don't run their own computers anymore. A phone on their own is nothing without email maps messenger apps browser cloud storage etc... So yes, nobody runs their own computer anymore. It'll be the same for llms. Can they run on commodity hardware? Yes. Will people go to lengths (including buying better hardware) to run gpt-lite instead of the much better internet-aware cloud llm gpt8?

[visarga]

It will become mainstream in a few years when every laptop, cellphone, web browser or operating system will sport local LLMs. For now it is a bit hard, but only a bit.