[vessenes]

Interesting. Upshot - right to left eval means you generally must start at the end, or at least hold an expression in working memory - LLMs - not so good at this.

I wonder if diffusion models would be better at this; most start out as sequential token generators and then get finetuned.

[jsemrau]

Try it out? https://deepmind.google/models/gemini-diffusion/