[6thbit]

They do stand in front of a great opportunity that would also benefit consumers, which seems rare in the llm era.

If people can get opus4.6/gpt5.5-like models locally, labs could raise their prices and sell token speed, better reasoning, mobile-focused improvements, you name it.

Not all consumers are power users and many will be happy to pay for flexibility.

[interludead]

Most people don't actually want to manage models, updates, context limits, quantization, etc. They just want the thing to work everywhere

[rbanffy]

Once one person figures that out and writes a blog post, everybody else can do it.

[oblio]

Yes, just like 90% of regular users set up NASes instead of just using Dropbox or Google Drive.

https://xkcd.com/2501/