[TeriyakiBomb]

Extremely high. Or at least several partial solutions that can be smooshed together.

LLMs really do still just reassemble things in their training data. There’s just a lot of it now, people anthropomorphise and struggle visualising large things. Some people say it’s truly reasoning but hit a topic that is under represented in the data of any LLM and it’ll transport you very quickly back a couple of years and ruin the illusion quickly.

[3form]

The problem being that I don't think there's a definite proof that any of human thinking is more than a sum of high-granularity partial solutions that can be put together.

It could be that with enough tokens, big enough context window, and ability to dig out the relevant partials, many such thought processes could be simulated.

[pertymcpert]

I think you’re just speculating.