Hacker News new | ask | show | jobs
by cma 867 days ago
Will your arch work for SSMs?
1 comments
trsohmers 867 days ago
Yes; Mamba was a very easy match, with Hyena also being a good match, but could be greatly optimized with some minimal changes to the model architecture or hardware design.
link