Hacker News new | ask | show | jobs
by karussell 3 days ago
Why would you need Omlx? For speed up?
1 comments
pornel 3 days ago
Has extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.
link