Not according to the hype merchants, hucksters, and VCs who think word models are displaying emergence and we're 6 months from AGI, if only we can have more data
Not according to the actual article that you're commenting on, either.
"As the researchers added more layers and parameters to the neural network, the results improved and the training process eventually yielded a solution that reached near-perfect accuracy."
So, no, we aren't asking too much from it. We just need more compute.
We know neural networks cannot solve the halting problem. But isn’t the question whether they can learn the transition table for game of life? Since each cell depends only on neighbors, this is as easy as memorizing how each 3x3 tile transitions.
The halting problem doesn't mean you can never decide if something cycles etc, just that you can't always decide.
As it stands, my guess is that the LLM would always confidently make a decision, even if it were wrong, and then politely backtrack if you pushed backed, even if it were originally right.
Every other day we see demos of AIs doing things that were thought of an impossible 6 months earlier, but sure, sounds like it's the "hype merchants" who are out of touch with reality.
My read of the comment is: "You are correct, but bear in mind that the world seems infested with people who are far less realistic and honest than you."
The rules also say "Please don't complain that a submission is inappropriate. If a story is spam or off-topic, flag it. Don't feed egregious comments by replying; flag them instead. If you flag, please don't also comment that you did."
I'm not really sure it's the best idea to accuse someone of breaking the rules if in doing so you're also breaking one yourself.
"As the researchers added more layers and parameters to the neural network, the results improved and the training process eventually yielded a solution that reached near-perfect accuracy."
So, no, we aren't asking too much from it. We just need more compute.