[Closi]

The original comment says nothing about benchmarking, they just say that an AI can’t one shot their complex task?

[amne]

When I read

"My favorite thing to ask the models designed for programming is ....... None of them ever get it right"

I read "benchmark".