[zsmi]

Wouldn't you use the Apple Neural Engine for that?

https://www.infoq.com/news/2020/11/apple-tensorflow-accelera...

"Recently Apple released the new M1 "system on a chip," which not only contains a built-in GPU, but also includes a 16-core "Neural Engine" which supports 11 trillion operations per second. Apple claims the Neural Engine will support up to 15x improvement in ML computation."

[Tpt]

The neural engine seems to be only about inference. For training it seems most systems rely on Metal like the Apple Tensorflow plugin [1]. But I have never tried to do ML on macs so I am maybe wrong.

[1] https://developer.apple.com/metal/tensorflow-plugin/