[dyauspitr]

Real world data obviously. When you have robots out and about everywhere there is going to be an endless stream of audio visual data. This is in addition to all the real world textual data constantly streaming out of our millions of systems. If an LLM gets “smart” enough to figure out how to filter out the massive amount of noise and use that to improve itself then we will have AGI. Not consciousness, just a self improving, very intelligent machine.