Hacker News new | ask | show | jobs
by ramzyo 1738 days ago
This is really impressive work. Would be interested to know whether they plan to support ARM CPUs in their runtime engine (currently looks like just a few AMD & Intel CPUs: https://github.com/neuralmagic/deepsparse). Many IoT and embedded devices with application-class processors could benefit from these speedups.
1 comments
ddv 1738 days ago
"Is there plan to support sparse NN influence on mobile devices, such as Arm CPUs?"

"Based on the amount of work for support, it's on our medium to long-term roadmap currently."

https://github.com/neuralmagic/deepsparse/issues/183

link
monocasa 1738 days ago
And no community pitching in to help with that either.

> Open sourcing of the backend runtime is something we're not planning for the near to medium term. It is something we're actively reevaluating, though, as the company and the industry as a whole grows to see what works best for the needs of our users.

link