[noemit]

Even if it runs, this will run slowly, and heat up.

I think local will always have a place, but the infrastructure is going to be used in my humble opinion.

[cmiles8]

Today yes, but between the improved performance of smaller on device models and the hardware itself getting better this issue is short lived.

[plussed_reader]

I don't want to put information into a black box of mystery that can then be used for other monetization purposes. I am still waiting for a realistic local solution.

[efnx]

Have you tried qwen3.5 running locally? It’s quite “good enough”.

[throwaway173738]

Compute evolved from batch systems with time sharing to responsive systems in your pocket. Why wouldn’t that happen here?

[gervwyk]

there was a time when mainframes was the main thing.. we’ll look back and say data centers was a thing.. (hopefully if we lucky)