[mahoho]

> Ask ChatGPT to play chess. It can generate a text based board and prompt you for moves, but it can’t reliably update its board correctly or even find legal moves. Note that I don’t expect it to play good moves, but the fact that it can’t even play legal moves should tell us something about its internal state.

Incidentally, I tried handing it a few partial games in algebraic notation and asking it to suggest the next move, and it generally suggested legal moves, though with tactical explanations that ranged from plausible to nonsensical. It refused to actually play chess with me though and I guess I just didn't have the right prompt.