Hacker News new | ask | show | jobs
by vanilla-latte 1252 days ago
One advantage that I have with the M1 Pro 32 GB RAM over my gaming desktop is that I'm able to run large ML models such as Bloom, Whisper, and Stable Diffusion with reasonable performance.
2 comments
abraxas 1252 days ago
How are you running them so well? What do you use for your device since CUDA is obviously not supported and 'mps' is not very impressive, compared it to just about any NVidia GPU including the aging 1080ti[1]

[1] https://sebastianraschka.com/blog/2022/pytorch-m1-gpu.html

link
vanilla-latte 1252 days ago
I wouldn't say it runs well. It runs faster than my desktop CPU, but slower than my GPU.
link
ganoushoreilly 1252 days ago
Out of curiosity what are your desktop specs? I have stable diffusion running quite well on a few different systems of varying spec. That said, it's great to be able to take it on the road with you.
link
vanilla-latte 1252 days ago
My dev desktop has the following: - Ryzen 5950x - 16 GB RAM - 1070 8 GB

The limiting factor was the VRAM. The M1 has the ability to use more VRAM than your typical gaming GPU because of the shared RAM.

I see this as a big advantage.

link