[abrowne2]

Curious to check this out, since they say it can run on a 4090 / Mac with >32 GB of RAM.

[ddtaylor]

I can run it without issue on a 6800 XT with 64GB of RAM.

[yencabulator]

"Can run" is pretty easy, it's pretty small and quantized. It runs at 3.7 tokens/second on pure CPU with AMD 8945HS.

[sneak]

I just ran it on a 24GB M2 air. Slow, but functional.