|
|
|
|
|
by somethingnot
2523 days ago
|
|
bfloat16 sounds like it could be supported with minimal changes to existing floating point units, maybe with just some improved microcode. FB's approach on the other side requires entirely redesigned and separate execution units. That's harder to justify, that silicon will remain dark for non-DL usage. |
|
I imagine it still keeps most of the performance benefits since it's eliminating around 2/3rds of the longest binary component.