[dbcurtis]

Well, except that the author misunderstands the specification and how it is typically implemented on modern computers.

[gdb]

(I work at OpenAI.)

TensorFlow by default is built with denormals off (ftz=true), so denormals aren't relevant for the applications we're interested in. We have updated the post to indicate this — thanks for the feedback!