Hacker News new | ask | show | jobs
by manmal 43 days ago
Have you tried the 27B dense version? It’s way better for coding.
1 comments
anana_ 43 days ago
Unfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is superior.
link
stymaar 43 days ago
Exactly. That's why I'm disappointed there wasn't a 122B version, it's 27B but for Strix Halo users.
link