[__loam]

I'm not sure I agree with that and I'm one of the biggest ai pessimists here. The gpus getting created to do this shit aren't just gonna get thrown out (maybe sold in a fire sale), and they're pretty general purpose. Tons of science needs massive compute.

[otabdeveloper4]

Using GPUs for neural network inference is inefficient and makes no sense, unless there's some hype bubble propping it all up.

Maybe sometime in the future a commodity manufacturer of massively parallel CPUs for stupidly parallel tasks appears, but Nvidia ain't it.

[happymellon]

How many cores/threads would you need to challenge the GPU?

Ampere has 320 core chips as a dual socket, although a 4090 might still be cheaper.

[otabdeveloper4]

80% of the effort and cost of a GPU is various bullshit related to rendering DirectX games on Windows.