[amelius]

You might then as well replace the multiplication by the addition in the original network. In that case you're not even approximating anything.

Am I missing something?

[dotnet00]

They're applying that simplification to the exponent bits of an 8 bit float. The range is so small that the approximation to multiplication is going to be pretty close.