Hacker News new | ask | show | jobs
by scarecrw 1255 days ago
I've played around with this myself a fair bit, so I'll add two things:

* I'm not sure if I buy the "chain of thought" approach as being very significant here. I haven't recorded my results, but I've gotten ChatGPT to answer correctly a significant number of SAT questions with much more direct approaches (e.g. "The following is a multiple choice reading question, answer the question and explain why your answer is correct").

* This was likely significantly benefited by the new format of the reading/writing section of the SAT. Previously, a substantial number of questions relied on longer passages and connecting ideas between paragraphs. These questions are from the newest version of the test which is exclusively fill in the blank or short passage questions.