Hacker News new | ask | show | jobs
by shardullavekar 93 days ago
has anyone come across an r2d3-style explainer for something as high-dimensional as a Transformer's attention mechanism?
1 comments
lamename 93 days ago
Not quite, but these help

https://poloclub.github.io/transformer-explainer/

https://youtu.be/wjZofJX0v4M?si=gT8Zlz1IY14KV_ju

link