[byzantinegene]

what are those limitations we're talking about? seems most of those the original limitations that people complained about were resolved through workarounds like tools and skills which are more software-engineering than llm advancement.

[vonneumannstan]

Long-term planning, context poisoning, task length reliability, etc. Improving all the time but certainly still constraints.

[nerdsniper]

The biggest limitation I see right now is weak “theory of mind”. It’s why even though AI can generate very decent exposition, it sucks at generating narrative. This also reflects in weak performance at humor, art, and even shows up in exposition (resulting in reactions akin to “cool story bro, but why should I care?”)

It’s why people can identify AI writing even if it doesn’t contain any LLMisms. AI’s generate text that almost looks like a human wrote it, but that no human would ever actually write - when we try to imagine what kind of person would have wrote this, we draw a blank - no one we’ve ever met would have written it like that - not even any archetype we’ve ever built an internal model for.