[jfengel]

LLMs are supposed to be a step on the route to a general AI. This is a data point suggesting that, if it can't do this simple job, it may never be suited to a wide range of jobs that any human can do trivially. That's a serious crimp in its reputation as an AGI.

There may be a solution to that at some point. But right now it suggests we're more on the stochastic-parrot track.