[elpocko]

>some major problems we’ve had with it. First is that it runs primarily on your own hardware

That's not a "major problem", that is the one most important core feature that anyone who is looking for full creative freedom and who doesn't want to enter "safety" censorship and surveillance hell should be looking for.

You can run ComfyUI with as little as 4 GB VRAM, which is not that much anymore.

[isoprophlex]

I run it on a 6 year old i5 box, no gpu, nothing. Granted, I'm fine with waiting 30 minutes for a generation, but indeed to be that's a core feature of the tool.

[elpocko]

I have a similar setup: I'm running a Discord bot for family and friends that can do image generation. It's a 6-core AMD EPYC VPS with no GPU.

By using a SD 1.5 Latent Consistency Model (LCM) it generates an image in 3 steps or fewer. It takes about 30 seconds to generate a 512x512 image on that machine.

https://civitai.com/models/4384?modelVersionId=252914

[lawlessone]

What's the power consumption on that ?seems like its more expensive to run than a gpu, but if you're not doing it often i guess it's not worth upgrading.

[isoprophlex]

60-70 W? Let's say 40 Wh per generation. Not so nice, but that works out to ~ 0.8 cents. So for a few generations a day, I can probably manage...

[jrmylee]

this is true. However I would my friends and I only have Macbooks so for us we wanted something that ran on the cloud

[spmurrayzzz]

Are you saying that the torch performance with MPS support enabled didn't meet your performance expectations? Or are you using an intel macbook and/or one with a tiny amount of ram/vram?

[jokethrowaway]

The M1 was released in 2020, chances are by now a macbook has ARM and neural cores which are ok to do local inference

[Auracle]

They’re OK, but certainly a lot slower than with an Nvidia GPU.

[nox101]

Modern MacBooks are great at this stuff since they have unified memory and the GPU can use all of it