[jhanschoo]

A basic transformer architecture performs only a bounded amount of computation per generated token, so it can never emulate a machine computing sufficiently hard problems.

[EVa5I7bHFq9mnYK]

Yes, because it's feed forward. It must have loops to be a Turing machine.

[phkahler]

It does. The output is fed back in.

[jhanschoo]

It indeed does, but it must generate a token per loop, and can thereby solve some linearly complex problems, but it cannot solve harder problems.