[pjmlp]

The world of GPU programming is more than just PyTorch for starters.

Then there is the quality of hardware, debugging tools, IDE support, supported languages (again isn't only PyTorch), and libraries.

[Zetobal]

Yeah, on paper there is in reality there isn't.

[archermarks]

Surprisingly, there exist people doing GPU programming outside of ML. I work in high performance computing and lots of people write CUDA code.