Hacker News new | ask | show | jobs
by softwaredoug 1265 days ago
The Bar Exam is multiple choice, right?

This isn't grading some freeform essay or generating arbitrary legal opinion. It's answering from a limited set of answers.

IMO it's cool, but not THAT shocking given what we've seen from ChatGPT? Especially given GPT 3.5 is only 17% below human test takers?

2 comments

From the article it looks like there are multiple choice and written sections but they only ran the model on the multiple choice portion.
No, you're thinking of the LSAT.