[qskousen]

Sorry this is a bit of a tangent, but I noticed you also released UD quants of ERNIE-Image the same day it released, which as I understand requires generating a bunch of images. I've been working to do something similar with my CLI program ggufy, and was curious of you had any info you could share on the kind of compute you put into that, and if you generate full images or look at latents?

[danielhanchen]

Yes we have started doing diffusion GGUFs but it's in it's infancy :) But yes we do generate images to test quants out!