[Yenrabbit]

FWIW I was able to get about 20% accuracy (perfect 4/4 groups) with ~50% of groups correct on average and most mistakes being groups with 3/4 right (so at least on the right track) with my first attempt at 0-shot prompting. The prompt goes something like this: ``` You are playing [game info] with [word list] Follow these steps: - consider possible groupings as initial brainstorming (>4 groups) - propose a first hypothesis based on the likely-looking groups - reflect on whether that grouping works - revise if needed then submit the final predictions ``` Having it start with word one of group one as the first output token seems unlikely to work from my intuition about what these models can do. Heck, I can't solve it that way! Burning some tokens on exploration and hypothesis building leaves it with the easier task of choosing plausible groups from the proposed options. System 2 thinking vs system 1 perhaps.