Y
Hacker News
new
|
ask
|
show
|
jobs
by
aesthesia
8 days ago
Audio is 1 dimensional so the usual RoPE position encoding should handle it like it does for text tokens. You only need extra position encoding for higher-dimensional stuff like images.