[jokethrowaway]

That makes perfect sense.

At the same time, will we ever get General AI just by throwing more data into the models?

Our biological brains definitely have way more data than the models we have right now but they also have different mechanisms which we barely understand.

I'm not confident we'll get human-like behaviour just by throwing infinite amount of data into a model, I think we will need significant changes to how we do NN as well.

Or maybe we just grow a brain in the lab, wire some inputs and outputs, train it for 20 years and then treat is a CPU.