Hacker News new | ask | show | jobs
by gwern 784 days ago
> A consequence of being an auto regressive model is not being able to plan token output.

Generating independent simple random variables requires zero planning by definition, because they are independent. And base auto-regressive models do it fine.