[yorwba]

The tokens of the answer depend on the preceding continuous thought vectors, which you can backprop through in the usual way.