I was curious about the new NPU in the latest Intel chips, so I did a benchmark with the ResNet-50 model (a very popular image classifier introduced in 2015 by Microsoft), and it turns out that running the model compiled for the NPU gives you about 15 times better performance than the CPU. This boost is for both, latency and throughput.