Hacker News new | ask | show | jobs
by pbmonster 3 days ago
There's an efficiency sweet spot where hardware that people have anyway gets a higher percentage of load.

MacBooks have a lot of memory and a lot of FLOPs. They mostly sit unused all day. Yes, the excess energy use will be higher than a GPU in a datacenter doing the same work, but you have to generate an absurd amount of tokens before the dollar-efficiency catches up with the MacBook.

1 comments

You need to have a 3k dollar machine available though, I think you are overestimating how many people have access to it