[steve_adams_86]

Are the neural engines able to be leveraged by 3rd parties yet? I thought there was no API available yet.

[rnosov]

They are leveraging Apple’s Metal Performance Shaders[1] not the neural engine. From the chart, it looks like you might get ~20x max boost on inference over plain CPU. Obviously, it's not like having RTX 4090 but better than nothing.

[1] https://pytorch.org/blog/introducing-accelerated-pytorch-tra...

[wmf]

CoreML is the API.