[Filligree]

The GGUF quantisations do run on most recent hardware, albeit at increasingly concerning quality tradeoffs.

[tripplyons]

I haven't noticed any quality degradation with the 8-bit GGUF for Flux Dev, but I'm sure the smaller quantizations perform worse.