Yann LeCun states on Nov 2015 (29:00 min mark) GPU's short lived in Deep Learning / CNN / NN https://www.youtube.com/watch?v=R7TUU94ir38
https://www.altera.com/en_US/pdfs/literature/solution-sheets...