[cameronh90]

> it might be too late and the proprietary ecosystem has probably won.

Compiler ecosystems can and have changed rather quickly. Especially given that most NNs run on a handful of frameworks. Not _that_ many people are writing directly on top of CUDA/cuDNN.

Make an equivalent toolchain that runs on cheaper hardware and the migration would be swift.

Currently AMD hardware is a bit behind and the toolchain is frustratingly buggy, but it's probably not as big of a moat as NVIDIA are trading on. Especially since NV's toolchain isn't particularly polished either.