[Iolaum]

Model Looks amazing!

Even more important, subjectively, is that this model will run very well on Strix Halo (e.g. Framework Desktop), DGX Spark kinds of devices. Looking forward to Unsloth dynamic mtp quants.

P.S. Looking at the HF release they already offer Q4_K_M and DFlash drafter for speculative decoding!

[verdverm]

I hope all models going forward come with a dflash drafter so we don't have to train one up separately.

[alfiedotwtf]

Also, that all models going forward target the base prosumer class ie today = Strix Halo