Hacker News new | ask | show | jobs
by nicollegah 1068 days ago
Wait are these inference times real? 1 second on a Raspi? Do I get this right? This is faster than on my GPU. What's going on here?
2 comments

Pretty sure that is just the text encoding step. Generating a complete image took 3h if I read correctly.

update: "Tests were run on my development machine: Windows Server 2019, 16GB RAM, 8750H cpu (AVX2), 970 EVO Plus SSD, 8 virtual cores on VMWare."

I think it's the inference time per iteration.
ahh thanks