[Hendrikto]

The translation happens because of token embeddings. We spent a lot of time developing rich embeddings that capture contextual semantics. Once you learn those, translation is “simply” embedding in one language, and disembedding in another.

This does not show complex thinking behavior, although there are probably better examples. Translation just isn’t really one of them.

[spartanatreyu]

Furthermore: Learning additional languages fine tunes the embedding.

[EGreg]

This is also the problem I have with John Searle’s Chinese room