|
|
|
|
|
|
by pama
985 days ago
|
|
|
Yes. For a model within the limits of the head requirements, however, you wouldn’t be able to see a quality difference from regular attention. Non determinism is a performance price; regular transformers may also suffer from it depending on the implementation. |
|
|