Hacker News new | ask | show | jobs
by snrji 2597 days ago
And why not the GPUs themselves? Which inherent limitations do they have? Aren't they essentially general purpose parallel devices?
1 comments

No, GPUs are quite different than CPUs with more cores. They're optimized for Singl-Instruction-Multiple-Data algorithms, in which the same operation is done at the same time to many different inputs (think image or video processing). They do very poorly in cases with complex branching logic.
I know, but isn't that what the OP was asking for? Isn't that an inherent tradeoff? Or: isn't that what Neuromorphic hardware and deep learning are about (ie. composing many relatively simple functions without complex branching/logic)?