[layer8]

IMO we won’t have the “it” moment until we have continuous learning (training) in some fashion.

[mattxxx]

^ This and we need to be continually learning on an energy budget similar to how much a human spends per hour.

[rlupi]

The main reason why we can't do that now is because we require models to be digitally reproducible (IMHO, but also read Geoffrey Hinton's mortal computing).

The energy cost come from error correction as much as training algorithms.