[jonfw]

> If I can use an open source highly effective LLM locally, and have it do all of the things ChatGPT can do

And if my grandmother had wheels, she'd be a bicycle!

We are miles off from open models having parity with what the AI labs are putting out.

And that's putting aside the compute requirements to run the top open models and the poor economics of running these models locally.

[solaire_oa]

Not all prompts require the same compute, and Gemma-4B runs on our phones with parity output for ordinary 1-5 sentence queries. The common use case of Google-style queries is already solved locally, saying we're miles off is ridiculous.

[rglullis]

It's not "miles off", the gaps are narrowing instead of widening and they are already more than enough for the majority of use cases.

Getting people to install a different chatgpt app on their phones is a lot easier than getting them to change their search engine.