Hacker News new | ask | show | jobs
by martinpw 775 days ago
The supercomputer flops are FP64. The A100 stats you are using are FP16.
1 comments

It's fine. We will simply run weather forecast in BF16 mode and hallucinate the weather.
Introducing our next supercomputer, Peyote.
weather forecasting is actually moving to reduced precision. none of the input data is known to more than a few digits, and it's a chaotic system so the numerical error is usually dominated by the modeling and spacial discretization error
A black Sharpie marker is even cheaper...