[hatsunearu]

A whole butt ton of GPU-style FMA and low precision float multiply ALUs would be my guess

[protomyth]

How low precision can you get and still have it be useful?

[fulafel]

Google's TPU proves that 8 bits is still good.

[sbierwagen]

Note that the TPU used 8 bit integer math, not even floating point.

[Govindae]

1-bit, binary neural networks work.