Hacker News new | ask | show | jobs
by microtherion 95 days ago
This is bound to be a question that will be increasingly harder to answer. For instance, Apple processors have at least two different neural accelerators/matrix coprocessors (ANE and AMX) in addition to the integrated GPU. Do these count as "CPU"?
1 comments

I think the answer is rather simple and boring -- only the CPU type commonly used in cheap cloud machines counts. This still is x86 only.

The homes at home, such as by Apple, don't count for serious workflows that must run reliably.

Personally, I love synthesis that can be generated on the client machine, in real time. For some applications, like screen readers, this is a really important feature.

Of course, the big interest these days is in cloud based assistants, where synthesizing on server and piggybacking on the rest of the answer is quite reasonable.