[seanhunter]

Say I suggest something : Play a valid game of chess at club level (elo approx 1200 say) using algebraic notation.

Then you’re either going to say it can or you’re going to say that requires more than 10000 tokens.

This isn’t an interesting conversation and I don’t think you are presenting this challenge in good faith for the reason I gave above.

[simianwords]

https://chessbenchllm.onrender.com

There are several models with greater than 1200 elo

Also https://dubesor.de/chess/chess-leaderboard

[psvv]

I'll admit that's better than I expected, but these ratings also imply there are plenty of humans who will beat LLMs at chess.