[j45]

I spend a lot of my time stepping outside of my shoes and making technical things accessible to non-technical people.

People having on-device private AI is something Apple is already pushing. Not sure if you've had a chance to catch up on that lately.

The important parts to explore are what people aren't doing, and what will be ready for people to adopt.

Still, this isn't the perfect example and I think it's a little unrealistic to use this as the reason to shut down the possibility of something easily existing on-device. But it is an example.

It's true, you're focusing on specifically how LM Studio works. But I provided an example that makes it a few orders of magnitude to use on a desktop, and for the interested, this is enough to learn from youtube.

You should see how non-technical people are learning to use AI and teaching others, it is very eye opening.

[verdverm]

I would look outside of what's happening in LLM / AI to see what things have looked like historically for other technologies. Right now, anything in the AI field is early adopters and not evidence for what will happen when mass adoption happens.

Search, browser, social media, email, laptops, phones, cloud providers, word processors, business office suites... brand name vs open source... it's a telling story

I'm not against people using local models, but from personal experience, I have a hard time seeing the average consumer choosing this route. People avoid the hassle of self management/hosting