Hacker News new | ask | show | jobs
by somethingnot 2523 days ago
bfloat16 sounds like it could be supported with minimal changes to existing floating point units, maybe with just some improved microcode.

FB's approach on the other side requires entirely redesigned and separate execution units. That's harder to justify, that silicon will remain dark for non-DL usage.

1 comments

It looks like a standard 32 bit float but with the mantissa truncated to fit in to 16 bits of storage.

I imagine it still keeps most of the performance benefits since it's eliminating around 2/3rds of the longest binary component.