[forgotmyoldacc]

It'd be great if you could add benchmark numbers for this comparing CPU/GPU on inference / sec and inference / watt.

[tdba]

Will do - as I mentioned in another comment, it can be a bit subtle to find an apples-to-apples comparison, but we'll soon add some cross-platform that we think are reasonable.

[37ef_ced3]

Please compare against https://NN-512.com

[tdba]

Sure, we'll check it out!