[lostmsu]

Latest NVidia GPUs are ~1.3-1.4 times faster, than previous gen with the same or lower power consumption.

[AstralStorm]

Moore's law is about transistor count and not performance. Performance of those parallel architectures always get subject to Amdahl's rule of scaling.

This is partly why we see slowing scaling in performance and why you cannot just throw cores at the problem.