[otabdeveloper4]

Using GPUs for neural network inference is inefficient and makes no sense, unless there's some hype bubble propping it all up.

Maybe sometime in the future a commodity manufacturer of massively parallel CPUs for stupidly parallel tasks appears, but Nvidia ain't it.

[happymellon]

How many cores/threads would you need to challenge the GPU?

Ampere has 320 core chips as a dual socket, although a 4090 might still be cheaper.

[otabdeveloper4]

80% of the effort and cost of a GPU is various bullshit related to rendering DirectX games on Windows.