Hacker News new | ask | show | jobs
by chrisjj 14 days ago
> you see LLMs use a lot of scoped imports and I think this is partly because it makes the output more resilient against failure to think forward at the start.

What makes you think an LLM has any such motivation? Or any motivation at all - beyond generating the most likely next token?

1 comments

The fact that RLVR rewards successful trajectories.

Notice I didn't use the word motivation, which you decided to use. The reason LLMs use a technique is simply because it works, and that comes straight from training (specifically RLVR post-training).