Hacker News new | ask | show | jobs
by abrowne2 397 days ago
Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.
3 comments

I can run it without issue on a 6800 XT with 64GB of RAM.
"Can run" is pretty easy, it's pretty small and quantized. It runs at 3.7 tokens/second on pure CPU with AMD 8945HS.
I just ran it on a 24GB M2 air. Slow, but functional.