Hacker News new | ask | show | jobs
by make3 42 days ago
Transformers are not Markovian, their whole point is arguably to be the reverse of Markovian, to efficiently make it so the new tokens are a function of all previous tokens