| The interesting part to me, rather than cost, is Energy usage. >The power consumption of the experiment is equivalent to 12,760 human brains running continuously. But the problem is this "brains" unit on AlphaZero doesn't seems to take into account of GPU, CPU and Memory involved. It only took the TPU numbers. Then there is another problem. > a TPU consumes about 40 watts,[1] The TPU referred to was a first Gen TPU built on 28nm running at 40W, more like a proof of concept. Currently Google is with Cloud TPU v3 [2], The latest-generation Cloud TPU v3 Pods are liquid-cooled for maximum performance. And each TPU v3 is actually a four chip module. [3]. If a single chip is 100W that is 400W per TPU. Edit: Turns out Wiki list TPU v3 as 250W. [4]. Not sure if that is 250W per chip or 250W for 4 Chips. That is on the assumption they are very high powered and hence would require liquid cooling. Although that might not always be the case. So adding CPU, GPU, Memory, and TPU figures. That original estimate of 12,760 human brains may be off by a factor of 10 if not more. Still pretty impressive. Considering we now only get about 1.8x improvement with each generation node. We would get about 19x by 2030. ( Assuming the same algorithm ). Which means AI is good, but human brain on its own is still very much magical in its efficiency :) Correct me If I am wrong on the numbers. My other questions is, that was how much energy it used to learn Go. But what about energy it used during the Game? How would AlphaGo Zero perform if it was limited to 20W? [1] https://cloud.google.com/blog/products/gcp/an-in-depth-look-... [2] https://cloud.google.com/blog/products/ai-machine-learning/g... [3] https://techcrunch.com/2019/05/07/googles-newest-cloud-tpu-p... [4] https://en.wikipedia.org/wiki/Tensor_processing_unit |