Hacker News new | ask | show | jobs
by Arcuru 17 days ago
Awesome! I've been waiting for them to start scaling ternary models for over a year[1]. Excited to try it out, typical Qwen 27B is too heavy for me to run on my local hardware at reasonable speeds.

[1] https://jackson.dev/post/dont-sleep-on-bitnet/

1 comments

Same here. I’m excited to have a model that might be usable on a 16 GB laptop.