Hacker News new | ask | show | jobs
by PaulHoule 743 days ago
For one thing, you have do a certain amount of looping if you want to, say, sort or systematically search a combinatorical space. LLMs don't do that.
1 comments

LLMs are auto regressive, meaning, to generate multi-word output, you take the old output, feed it in as input and get the next word. This loop provides all the basis for recursive thinking.

Perhaps you can say that current context-limited approaches limit the total memory of such a thing. Obviously that is true, but not functionally different than brains or computers.