[smallerize]

That's called a recurrent neural network (RNN).

[DoctorOetker]

distinction is that GPT allows a lot of parallel computation compared to RNN, but I see how your remark indicates a convergence towards RNNs indeed.