[whytevuhuni]

Is LLM inference mathematically reversible?

If I say "42", can I drive that backwards through an LLM to find a potential question that would result in that answer?

[willy_k]

Not currently AFAIK. It is an active field of study though, mechanistic interpretability.

https://arena3-chapter1-transformer-interp.streamlit.app/%5B...