[93po]

Maybe I’m off mark here but it seems like video footage of real life would be a massively beneficial data set because it can watch these videos and predict what will happen one second into the future and then see if it was correct. And it can do this over millions of hours of footage and have billions of data points.

[HarHarVeryFunny]

Yes - that would help, but only to limited degree if just part of training set.

1) Really need runtime prediction feedback, not just pretraining

2) Really need feedback on results of one's own (prediction-driven) actions (incl. speech), not just on passive "what will happen next" observations