[ragebol]

Which should be worrying. It's also why most people don't pass (nor try) the bar exam.

[sureglymop]

But let's be real. You can pass the bar exam with a lot of studying and memorizing (and many people do just that). A better test for whether the AI can do reasoning is some sort of puzzle which requires a creative solution.

[Aperocky]

Not really, this demonstrated how bar exam don't require a large amount of reasoning, but lots of recitations.

Humans are bad at reciting things, but a lot better (compared to GPT) at reasoning.