Hacker News new | ask | show | jobs
by corimaith 592 days ago
The reasoning emerges from the long distance relations between words picked up by the parallel nature of the transformers. It's why they were so much more performant than earlier RNNs and LSTMs which were using similar tokenization.