Hacker News new | ask | show | jobs
by brookst 18 days ago
Here’s some of those sources that were apparently hard to find:

https://openai.com/index/openai-o1-system-card/

https://arxiv.org/html/2410.10630v1

https://magazine.sebastianraschka.com/p/understanding-reason...

1 comments

Reasoning models are mostly regular LLMs trained to output a "<thinking></thinking>" token delimiter before the answer that will be shown to the user, and that's a clever use of the Chain of Thought idea. All of which I'm completely familiar with.

GP was saying

> That would be true of non-iterative models that just emit an output from beginning to end.

Which suggests that there are

- "iterative" models

which

- do not output "from beginning to end"

which AFAIK is science-fiction.

Diffusion language models aren't GPT-5.6 level, but they're not science fiction either.
Thank you ; I had completely forgotten about those. I stand corrected.