[kelseyfrog]

LLMs are calculators for language.

Just as the calculator cleaved computation from mathematical understanding, LLMs have cleaved language use from linguistic reasoning. We used to treat expression and comprehension as tightly entangled. Now they're demonstrably separable. We’ve built a machine that can "speak" without understanding, just as calculators can "solve" without knowing.

[wkat4242]

I really like this way of putting it. Thanks!

And yeah I think the industry leans too heavily on LLMs right now. They don't understand, but they're really good at making it seem they do. Then the users get impressed by that and want more and more stuff that requires understanding and the industry just makes it because $$$. But because of that it's so hit and miss.