[mjburgess]

LLMs are just modelling token order. The weights are a compression of the outcome space.

No, causality is not just an ordering.