[LeanderK]

> The neural engine is small and inference only

Why is it inference only? At least the operations are the same...just a bunch of linear algebra

[londons_explore]

Inference is often done fixed point, whereas training is (usually) floating point.

Inference also prefers different IO patterns, because you don't need to keep the activations for every layer ready for backpropogation.