|
|
|
|
|
|
by bonoboTP
4 days ago
|
|
|
Yes, but it wasn't invented from nothing in 2017. Soft attention existed in other applications like information retrieval, Nonlocal networks had similar ideas as well. But it wasn't seen or used as a fundamental building block. But it wasn't something out of the blue either. |
|
|