[gpderetta]

Also, custom ASICs are the current state of the art for NN.

edit: missing word

[p1esk]

Which custom ASICs are you talking about?

[gpderetta]

I'm referring to Google's TPU.

[p1esk]

I couldn't find any details about that chip. How do you know it's state of the art?

[gpderetta]

I only know what is publicly know. It was discussed a while ago on HN. I think that google claims the best performance per Watt and manages to do that with specialized 8 bit floating point ALUs. I don't think it has been publicly available yet so the claims lack third party verification.