Hacker News new | ask | show | jobs
by haddr 812 days ago
Will it be possible to run such model family in ollama?
1 comments

Mamba is supported in llama.cpp so should be (edit - apparently it's not strictly the mamba architecture, it's a mix of mamba and transformers, so it looks like it would have to be ported to llama.cpp)