[eamag]

A more focused way of generating ideas would be to have a multi-step approach, define the scope, collect information, generate ideas, clean up, expand/deduplicate, evaluate and rank, see a figure 4 from a review [1]

I tried to do it based on ICLR conference, and rank via LLM-tournament, see result https://openreview-copilot.eamag.me/projects and process https://eamag.me/2025/Paper-To-Project

[1] https://www.semanticscholar.org/paper/A-Review-of-LLM-Assist...

[apercu]

You’ve described my manual consulting process :)

Except when I have access to the right ears I force some measurable success metrics at the beginning to maintain scope stability after agreements.

[ajoshu]

Interesting, thanks