[corry]

I mean, an LLMs ability to solve a logic puzzle seems like a weird way to gauge how it could be USEFUL to you (even if it otherwise would be a good test of how 'intelligent' the LLM is).

Do you search Google or Reddit and wish you could just 'get the answer' instead of wading into pages/posts?

Do you compare two long documents together and not want to invest a few hours into a close reading of them?

Do you write code that consists of trivial functions or trivial text manipulation?

Do you want a 3-hour podcast summarized into a few bullet points for a particular audience?

Do you want to send a saucy limerick to your friend on their birthday?

Do you want to compare Kant's view on <topic> with <new_metaphysical_school_of_thought>?

Do you want to analyze 250k rows in an Excel file of user support tickets and summarize the top issues?

etc etc etc.

Totally fine if you don't do any of these things, but these are the things most people are using LLMs for.