[saagarjha]

Single-precision is too expensive for GPUs, unfortunately.

[pclmulqdq]

They may be too expensive for ML (or really not pareto-optimal for ML), but people use GPUs for a lot of things.

[alkonaut]

I think you mean double precision?

[saagarjha]

No.

[alkonaut]

Can you elaborate? Outside of AI workloads, almost all computations on GPUs are single precision. Double precision is pretty rare, and smaller precision is mostly useless outside AI (and obviously irrelevant for trig precision)

[saagarjha]

Unfortunately almost all computations on GPUs are AI workloads.

[pclmulqdq]

Uh, what?

The main usage of GPUs is graphics processing, and it's not even close. That is what Graphics Processing Units are built for. AI is probably the main use of datacenter GPUs today, but even that isn't "almost all" in comparison to the HPC work out there.