[ydj]

How do you determine that the model was reasoning in Chinese in layer X? I would think the middle layers do not map into any tokens.

[s314]

Using a logit lens (prior art: https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreti...)