[jaruche]

I wonder what is the diference between a neural stack and An LSTM? Aren't both keeping a state?

[williamtrask]

They are similar in that way. Typically an LSTM is used to control the neural stack... so the stack sortof "sits on top of" the LSTM's memory... allowing it to be (in theory) infinite.