Hacker News new | ask | show | jobs
by brucethemoose2 1037 days ago
Interesting. It still doesn't seem to be very quick: https://github.com/leejet/stable-diffusion.cpp/issues/6

But don't get me wrong, I look forward to playing with ggml SD and its development.
1 comments
WinLychee 1037 days ago
Yeah for comparison, `tinygrad` takes a little over a second per iteration on my machine. https://github.com/tinygrad/tinygrad/blob/master/examples/st...
link
brucethemoose2 1037 days ago
Is that on GPU or CPU? 1 it/s would be very respectable on CPU.

The fastest implementation on my 2060 laptop is AITemplate, being about 2x faster than pure optimized HF diffusers.

link
WinLychee 1037 days ago
That was on GPU, and there are various CPU implementations (e.g. based on Tencent/ncnn) on github that have similar runtime (1-3s / iteration).
link