[Aunche]

> As shown in the amount of compute used to train deep learning models has increased 300,000x in 6 years, increasing at a far higher pace than Moore’s Law which posits that the amount of computation that can be done per unit area would roughly double every two years. This means that power consumption per unit area is not staying constant as implied by Moore’s Law [108].

IIRC Moore's law doesn't make any predictions about power consumption at all, let alone ones meriting being cited in a scientific paper.

[dekhn]

yeah, I've debunked this particular line as being technically nonsense. If I were a reviewer of the paper, reaching a sentence like that, I'd return to the editor with "revise and resubmit- this doesn't meet the basic technical level of expertise we require for publication."

if you build 2X the compute capacity with current nodes, you didn't violate moore's law.