[thesausageking]

The Q&A section on their compiler and software that the author links to is very interesting:

https://www.youtube.com/watch?v=j0z4FweCy4M&t=8047s

It sounds like they're going to have write a ton of custom software in order to use this hardware at scale. And, based on the team being speechless when asked a follow up question, it doesn't sound like they know (yet) how they're going to solve this.

Nvidia gets a lot of credit for their hardware advances, but what really what their chips work so well for deep learning was the huge software stack they created around CUDA.

Underestimating the software investment required has plagued a lot of AI chip startups. It doesn't sound like Tesla is immune to this.