[meatmanek]

I've played around with the same problem, though I didn't do any fine-tuning. Some strategies that seemed promising:

  - A two-pass approach where you prompt it to generate the groupings, then separately prompt it to find the words that belong into each group. (Which of the following words best fit the category "COMMON DOG NAMES"?). It does way better at the more specific queries.
  - Don't tell it the constraints of 4 groups of 4 words; ask it for at least four groups of 2 or more words. Once you have 4+ groups of 4+ words, you can make logical inferences with your Python wrapper to come up with all the possible 4x4 groupings. If you're lucky there will only be one. If not... more queries to GPT, I guess, but I haven't figured this part out.